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FOREWbRD 



Since l£r69, thte Michigan Cauncil of Teachers of Mathematics 
'has steadily maintained Its iirterest and involvement in 
the Michigan Educational Assessment Program. Knowing that 
the state- iegislaturfe^ and the department of education were 
bent toward an extensive assessment ^i^rogram, the MCTM ; 
proposed to make -every effort 'to^ssi^t in assuring that j' 
't\^e program would make a positive- contribution to mathematics 
instructioi 



The yCTM- recognizes the ^eed ^or a more objective basis 
• for decision-making, in' education. -It has continuously 
.assisted, in efforts to identify iliinimal 'objedtiVes and * 
develop test items . ^ This monograph is a 'part of this 'effort 
ta provide, for hettfr local anfl state-w^ae determiifktion of 
mathematics^ curricula; ' * ■ . , 



.Dr: Charles Zoet has done an excellent j.ob in sifting the ' 
1970-73 mathematics asse^smehf data for implications. His ' 
considerable experience and talents haye' enabled him to mak^ 
many insightful observations. ' " . . , 

. . Terrence G. Cobur^ 



TO THE READER 



.i would' like to take this. opportunity to alert the- reader 
to ^he nature of the analysis presented in this -docijinent. 
The anajig^sis 'has assumed^jAat the primary group readers 
will^ b'e teachers of mathematics ahd others int^re^sted y^i 
improving mathematics programs. .Therefore, th^ conject^ureS" 
and observations presented hre those vhich'^weref .th9ug}it to 
be of interest to that group. ^ ' 

While a |reat amount of data was presented for.th^s analysi-s, 
there was little opportunStp^ to assemble comparative ' ' ' 
statistics which fit a classical research model. Since the' 

V * 

resvlts of classical 'research .in the educational ^ield . - 

* 

frequently conflict 'and since it wa^ believed . that such 
research would not be. o-f primary interest to the feraders,^ 
have worked freely with'' some very simple . data. Substantial 
statistical data' could be assembled to suppprt some of the 
findings; with others, i have simply drawn *on my background 
and experience to present conjectures in'which I" may be . 
completely off base. The context is such in tfiose case^.that 
it should^ be clear- that I am drawing "lieavily on. my own 
perceptions.. ' * ' • - ■ * * * V * 

With so much data available on so many cpn<^epts, it did not 
seem to'mp that there was any gjreat virtue in timidity. At 
the very least it •is my hope that the dpcument does stimulate 

interest in *the development of matliematical concepts in young 

, " . ♦ 7 . * • . ^ 

students. * • • ■ 



. f 



Whiie/the MCTM has permitted me a great amount of freedom 
'in developing the rfature of this^ monograph a numSer of 

\pe(!^le did coXtribute substantially to the final document. 
First ^ of all, Mr. Jules Shrag'e of Oakland^ Schools did ^ 
some preliminary organisation and arraiysis of^ the data which 
was .most- useful in narrowing the focus of this. Analysis.' 
Dr. Tom Fisher and Dr. Robert Huyser of tKe Michig-Sn, 
Department of Education, Doctors •William Sway.t and Jim^ ^ • 

""Bidwell.of Centra Michigan University and Dr. Terry Coburn* ^. 
of Oakland 'schools dil submitte<l extensive and helpful 
editorial comments on the first draft of the^ document and 
assisted In bringing it to its final form. I /am grdteful 
to all of ;them*for their help. * ^ 

Finally whatever ability I may-have to see instrucj^ional 

implications in data of this nature has been cultivated 

through my work in LivoniA Public Schools- -a distVict which 

believes that critical analysis of the results of "instruction 

) is* absolutely necessary to the continued improvement of 

• • • • ' 

. ' ,progYams. They supported their, effort in many ways and. I 

"am particularly ^grateful that I 'have *had tha. J|portuni-ty to". 

spend my professional years in such a' ^jetting ."^ • 



' * Charles J. Zoet 

/ ' . * • May 1974 
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■ . . » ■ ' iNTRobue;?ioN " 

The purpose 'Of .this monograph is to analyze the 
result-S ■ of student , per formancle 'oh the mathematics portion 
of the 4th and .7th grade tests administered by the' 
Michigan Department of Education early in 1970*, 1971, 1972, 
and 1973 and to ide^itify information which may be.us;^ful to 
mathematics teachers in- Michigan. ■ • * • 

Achievements in mathematics by 'Michigan students are ' 
1 now'.beih'g assessed through objective' driente'd tests. 
Therefore np recommendations are made here for changes 
in past -testing programs. A later monograph will deal with 
'information coming »frbm the new objective oriented program. 
.The. major focus of this- analysis will be on the performance, 
of Michigan students on individual test items. 

Under, the Michigan Educational Assessment Program (MEAP) 

tes-fs covering a variety of basic skills in lan^age arts . 

and mathematics werfe administered to nearly all Michigan 

'4th ank 7th graders during the school. years of 1969-70 to 

1972-73 .< These achievement te^ts were prepared by the , 

'Educational Testing Service" under contract to" and in 

;Qooperation with the MDE. .Instruments de,signed to measure 
I ' , ^ ■ , ' ■ 

• d variety of socio-economic characteristics of school 

districts (and other organizational units) accompanied 
.some of these tests. 
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/ PURPOSE- AND DIRECTION OF MEAP . .. ' 

^ - Tke decision-making and impl^ementiii^ process at trhe 
•state level is an extremely complex mix of^prafessional • 
judgment^ poli*tical convenience, economic flue tuationg, 
personalities, practical necessity, and historical deadlines. 
.While MEAP has become part of'^^a six-step^ long-range plan 
to mandg^ Michigan schools' rationally,' the commitmen.ts/^V'^ 
neces^ry to such long-range management, heye not', yet ..fe^en 
% made . ' ■ • . ' ' 

In order to avoid being ensi\ared by the- intricacies • 
of thjg politics involved let' us simpXy recognize that the; . , 

3ame financial prqblems and absence of long-range commitment 

* * ^ ' 

which enmesh loc^l school units extend to. th6 state 

. Departmejit Df Education and comjj^Licate attempts to develop 

morev effettive schools. Readers interested in pritical 

analysis of MEAP/testing programs are referred to critiques 

, such as thes6 T^y* tTie l^ichigan Association of ^*Prof essoT^ 

Educational Administration (23) ^and Oakland Couirty (24) as 

^ well -as the MDE responses (11,^2). 

In August, 1969,, the State Superintendent of Public ■ 

'Instruction introduced the ihitial .thrust of the Michigan- 

Educational'' Assessment Program emphasizing i^h^t: 

"The fuH implementatiion . of a m^eaningful assessment 
program, will -not be achieved ip the period of one 
year. , Nor will 'it be achieved without the cooperation 
; and involv.ement of professional educators' an,d lay ■ 
citizens The task at hand is a complex one and will ' 
necess*itatp systematic planning and development over ^ 

: J -. 
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a period of many months. The activities which * 
. wil.l be.ufrdertal^en during the 1969-70 sthool 
.'' '.'/ear -r^presettti only- a beginning step in a lojig-' 
.,• range program designed to provide' better and 

mor.e comprehensive information concerning the" 
< ■ . -level, distribution, afid the progress oif 
. ^ educatij>n- in .the.scjiools of'.our statue;" (l,Fofeword) 

The evolution *o£ .MEAP, 'projected, in that paragraph, ' 

was apparent in a year-to-yeay sh4ft;^f emphasis from' 

better allocation of monies, to acqountability ^to parents, 

students, schdol boards , and the s'tate; and .to assessment*. 

J* • ■ ' ' ' • 

of educatiiin needs to, ifliplemeht the MDE six-poiijt program. 

' - . HoVever ,' ■ the major objectives , for MEAP remained 

•consis:tent through th6 four years of testing examined Un k'" - .^'^ 

thi'S analysis. Brief l-y stated they were ' '^//Vr-fM^^--, 

Cl) to proA^ide the state level decision-makers with- ^-"^ 

. / information' for use in allocating*,state resources-. 

: (2) to provide local decision-makers with .informati;^n"' * 

»' * *> * 

regarding their, schools for- use In the 4esign\o£ 
T . future ^educational programs 1> r' A . • 

. (3) to provide Uasic in/ormation about " stud^^nts to ' 
help' assess their progress and ;to identlify students 
(and' districts?) who have special need o£ assistance. . v 
(4) to pi-ovide all interested people with' information ' 

regarding the progress of education statewide and' . -: 

, in indiyidual sthools.. or school districts. ' ■ . 

' ' . ". '" . " ■ ■ • ' ■ . ■ ' 

As It applied to basic. ski;.ls in 'mathematics^ the , • . 

assessment program 'strove to .answer three questions:* 

--Is the level -and distribution of basic skills Improvihg 

iinbng the state's school districts? 
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* -"Is the level and distribution of b^sic-skills 
' ' ^jnpxoying witHln a .particular school district? 

^ --What is- tha^chieyeiaenrt level in ma4:hemai:ics in 

> ' ' V \ ' » ■ • 

id its scJiooT districts?' * ' * • 



• '•Itg?^d§? to find a starting point jvhich would-give * 
some^.-b'xj^adth to their look ^art/ educational inputs, basic 
s^^p.a':^ etc .the hIDE elected to\begin its testing. at 
the 4th and 7th' grade levels. While..there have been some ^ 
indications thaf a fur'ther expansion would includp grade 

,ten, a firm cyommitmeiit to Q^tend'.the prograjn-was placed 

' •> *• * . . > • 

' in reserve. .' " ' » ' 

^ The limited amo.uiit of useful instr.uctional .information 

and inconcluSiveness 6f the^ test results , during thes'e 

>:ears> represent the "pitfalls of a.ttemptirig" to derive data 

• ;for the im'provement of instruction ftoni a ; test i^ig .program 

, not designed' fox* that purpp^e.- The^tests .involved • • 

' > . ' ' ' . 

literally millions of houts .of §tudei>t aijdvpYof essional' ' 

time T)ut fre^quently' By-passed mathematical concept? wKich 

af6 critical at the .level tested. The limita'eions are more 

sobe.ffi.ng whi^fi viewed- against what nijight Tiave be^n* , , 

" *• ' * ^ . . /"'^ ' . , ■/ . ' 

Thosa>Temarks are intended to be- critical' , of <the 

educational decision-making process and not of attem]^ti : 

to evaluate programs* The iajtteiT is' pirobably .es^eiitial to 

' ^ ' * . ' " ■ . - . v'.' ' \. 

Statewide ifoprovefeen^t of education, Hi^wever, it is >^ry^ 

difficult to conduct* a iheaniAgtul fevaluation in a 

* V.:../- • ^ , • 

sociological 'arena ^.en when there- is. clear lpng-^:angp 

iC'ommitmejit to gettip^accurate and usef^il. curriculor data^, ' 



The absence of a specific long-range design for that 
purpose simply increases the difficult-y. - 

THE MTHEMATKS TESTS' . , • ' 

The mathematics tests with which ^is taonograph is 
concerned were a'dministered to 4th and 7t;h graders during 
%he month^of January in 1970, '71, 72,and*73. The following 
table summarises the niutfber of students and school districts 

r 

tested during those-^aaj-s. 



1969-70 , ■ 1970-71 



• - ■ 4-th 7th 4th---' ' 7th -'-^ 

•NtEifaeT'' 6£ '■ - ' • - . ' . 

lUstricts . 585 566 ' . 612 ' 584. 

' ' ' ' * • * * ■ 

Schools * 2,"492-.': • 909 -, 2,529 _ 902 

Pupils ' . i5«*,7X3 . . 159,4--07 . 161 ,'-^99 ' 162,''585 V 
. '. — t-— • " ' 



1^71-72 " . 1972-73 

b - ■ 



.4th • - 7th ■ - 4th . ■ 7th 



Number of ' ' 

Distaricts » 608^ ■ ' 58r /604* 577* 

Schools 1 2,4«t5. ' . 91Z* ' 2,470*. (.9111!* 

Pupils 162,280.- 164, 60I'- 157,854 160,200 * 

— — ■ • ' ' . ^ : — '— — f. ' • — ^- ■ 

^Approximated from the data availaBle, ^ 

Educational Testing Service '(ETSj ^. i>rincet6n. New Jersey 
was ass i^nfed prime responsibility for developing t>he tests 
to be used iii as-sessl^g Jbasic skills' in. mathei3|atics. The 

supervised, the contract 'for thi^ development and frequently^ 
consiirted with ETS as 'the warlc developed.' This four year * 
Vesting period beganN;(ith a crash program authorized by the 



legislature in August 1969 for implimentation in January 

• • * / 

19^70, /Since the initiial 'reacti-dn to £hat progr^ the < 

f M~ . ' ■ 

IhfflE h^s continually looked £01: ways to invol^ve the • ^ 

educational coAmunity in djecisions-' Regarding the testing 
progrd^ By 1972;-73 a MEAP advisory councjli of eight * 
members repr^seating the educators of the .state had be?n • 
formed to advise the MDE^ 

I 

Specifica tions 

, ^he constrxlcTtipn of a test begins with a set of 

Specifications .dfe^crlbing the- objectives to be tested. 

In this case: • . 

• * 

. ''So that t-he achieveipent test used in the^^Michigan 
Al^essmerit Program might Accurately reflect the 
objectives .of education -^n the state, the professional 
staff of each of the several departments of the 
Test Dtfvelopm^t Division of Educational Testing 
* ^ ServicQ. wrote a set of preliminary test specifications 
^ based on texts in use . in Michigan Schools." (15,24) 



The specifications were modified through interaction wi 
an ad\ hoc commi;^^£rrappointed by the MDB/ The final 

mathematics -test [specifications for the 196-9-70 school year 

* r * ■ * ^ * 

c-ove-red tliese broad areas: » 

Number and' Operation ^ 

r 

Ceometry and Measurement 
' ' Relations, Function and Graphs 
, • • Logical Thinking 

Mathematical Sentences 

4 

Applications 
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• • • 

A more detailed description of -^hose specifications 
- and the published distribution of questions among them 
during *the four-years appears in APPENDIX Av" 

Since these were taken fro;n. "texts in use," tK'e tests 
might more reasonably be expected to assess the effectiveness 
of those texts than any other* single ingtedient. ^Howe^ei' 
instructional materials are used by teachers and students in 
»a variety of school settings. It Would be misleading to- - 

• • . ! ' ' 

. suppose that whatever strengths appeai;^ can be attributed to ' 
the texts or that weaknesses can be remedied by merely 
changing texts. Mathematics delivery systems are 'a bl^end of 

, all four factors; materials, teachers, students, and programs. 
]k is important to note that this process for identifying 
objectives cannot »"be expected to identify a mathematics 
program which is distinct to "MitfiJgan". Since the textbooks 
used in Michigan probably represeAt a cross-section of ^ those 

. used nalTLonally, rhexe is noxhing ^uniquely ^IMichigan^T in^ 
these specifications for mathematics. It is also worth 
noting that the assumption that teachers do. teach what is 
in the textbook is a very broad generalization. In fact they 
"teach some subset of that material ^nd it is likely that a 
small ad hoc committee could accurately identify its eleijients* 
without some systematic sampling. . ' * 

This is illustrated by the fact that during these four 
years of testing, there was one whole nuinber addition, item 
in one of the 4th grade tests and the other tests contained 
none. It is very likely that whole nuinher addition is a 

'•15 
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iiiajor- objective in 3ri grade mathematics in Michigan and 
it should have been well covered in the 4th grade testing'^ • 
program.- ' o . 

The testp for 1969-70 contained 30 items and were 

t 

administered in twenty-- five minutes*. In the next three ^ - 

• • • 

^ars, the number of items grew to 40 and the time to ' 

30 minutes. . . * ' 

The relationship *of the test items used from year - ' \ 

to year does not appear to hkve followed any particular 

pattern. A total of 33 items were used in the 4th gradfe 

I t 

^testing and 79 items in the 7th grade. . TMs* table -shows 
the number of items which were used on one,, two; three, or' 
four of 'the tests. ' 

Frequency of Use - ■ 
of Test Items , Niimbej: of Items * 

\ • . " ' Grade 4 . Grade' 7 

Used on 1 t^si. . • ' * » 4 4 - ft ^ 

r Used -on 2 tests ^8 (9,4,5,)* ''^ 21 (6,6,9)* 

Used on 3 tests , 14-(4,10)*" rS;.{6r,7)* 

Used on all 4 tests _7 8 J . . 

J Tot^tl Items , . 83. . '79 

^Parenthetical numbers show ,i;ow those items were distributed . 
among the' first two years, second' 2 years, and last two years 
or first three and last three years. For example; at grade 4, 
9 items were common to the first two years (*70, '71) 4 to., * 
the second two years ('71,^72) and 5 tovthe las'^t two years. 
J ('72/73). . \ ' • 

• • * 

There Vas a commitment to contiiiue a sufficient number ^ , 

of items from jear to year to facilitate^a statistical 

* • 

16 . 
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comparison o£ performances. Jte^ changes permitted a 
gradual improvement in the selection of items as well as' 
some shift in 'the * objectives tested. \, 

Technical Analyses of the Tests 

ETS published technical- reports describing, the tests 
u^ed in each of the firtf three years that the tests were 
administered. These reports' discussed mean\ scores , 
standard' deviation, reliability, Validity, jaifficulty level,* 
it^em difficulty,' fiming effects and discrimination power 
of each of the tests.. In Mafch 1973, the MDE ,also'*pubiished' 

,an ^'Equating Report'^XlS) which discussed the technique 
for comparing scores achieved' ofi the tests .administered, 
during^ the 'first three years. These reports were based pn/.* 

•a '^spaced; sample" of approximately 1000 students each year 
with checks being bade against'* the' to^'tal group to establish 
the representativeness of the Sample. , ' / 

• Statistics describing the mathematics .tests in' terms 

> ' ; " . , ' * y ^ 

of the chafacteriistics listed above are contained in 
APPENDIX B- \ . ^ ^ • 

'Sased on generally acceptable standard's' (25,27) the - 
tests for mathematics were reported ^ be reliable^ ti^e 
limitations were not.*^ factor, they discriminated fairly .well . 
between strong and weak students a^d they i^ere somewhat 
difficult tests .of this type. The equated scores indicated 
• that thg. average performance did' not shift significantly from 
year to year . . In the case of mathematics, "the 1970, 1971, 
and i9'72. test- averages arfe identical." (18, p. 18) 



Later (13) the MDE also published equated scores for 
the 1972-73 testing program. Tha.t reii.ort appeared to 
show a slight improvement in 4tTi grade mathematics scores 
for the fourth year of t.estingl *' j 

The "content validity" of a test "is an indication/ 
of the extent to Which it does the 'job it is intended^ 
'to."*(15,p.i7) ^ . . ' ' . . ^ 

"Content validity rs ensured by ^^htrUsting deyelopment 
• #oS 'the tests -to specialists in *test con*3truction and 
• in the subject to be covered".'* (15, p. 17) ^ ^ 

• ***** 

. "The conten.t validity of -the achievement^ tests-, . . . ,"can 
be judged by the procedure used ij;^ their development 
and by inspection of the classification of the test- 
questions intoc various se^^enits of 'the content domain-" 
(16, p. 21) - 

"Coramittee^^ of Michi-gan educator's .assisted in the 
development and review of it#t. In doin§ so and . 
because of the representat;lv^h^ss of- the contei^t 
domain, the test', can be judl^ed^as having a high, 

• cpntent validity.^'.' (17ip.24j ^ 

•These ^^tatements represent ^^fadual'^shifts^ in the view 
of\content validity in matliematics /-^sts • In September 1973 
the use of objective referenced -test§ related to objectives 
determined completely by Michigan ma^ematics educators 
represented the* MDE recognition that ^^^sessment must be in' 
terms of wh^t mathematics educators .irii^ Michigan schools are, 
trying to accomplish. ' The new tests- 'consisted of sets of 
items developed tb assess the achievetidht of specific* 
objectives contained in Minimal, Per forage e> Ob j ectives for 

:^ ^ 

J^lathenatics Education dn Michigan, CiA) 

You are referred to the technical reports themselves for 
technical questions about the\ earlier tests which require 

greater detail. j^g . , 

• • • ^ • 

10 V • 

; • ^ ^ 



Item Statistics • 

Finally, for- the purpose of this analysis^ ETS submitted 

tl?e statistical* data which it uses to examine performance' on 

test "items. Th^ following statistics were among the nineteen 

pieces of data available on each item. 

--Number of students who selected each r.e3ponse to the 

Item. , • 

-•A mean criterion score 'for each .r*esponse; this, was. 

a score from 6 -.20, average 13, "describing 'the 
-• - 

over-all test achievement level of the students who 
selecte'd that response.'-' The higher, the'criterion 
score tife more' capable the group of students . 

—A mean criterion score for the students still ^answering 
questions and the perce^itage o"f students' still i«answerin* 

. at 'that item. 

-•Percentage of. correct response to the item based on 

thos.^ still responding. ' . . 

-<\ me,an criterion, score for the itemJ This was also ' 

based on 20 scale as described above. Jn this 

^ case the higher the criterion score the more* difficult 

the item. In this Analysis we will abbreviate this 

score as' DL - difficul*ty level. / 
--A corresponding Qtiterion. score .for the item assuming 

it has been given to a base group, in irhis case students 

writing in 1969 - 70. , . > 

• -A' (Correlation coefficient comparing performance on this 

item to overaH performance on the entire test. 

19, 

• » ' ' 

11 
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• A more detailed crfescription of these data taken 
from. an ETS manual (19) are included as APPENDIX C. 

, ^VALUATION OF THE TEST* RESULTS 

OVERALL TEST PERFGR^IAJTCE * . , > - , . 

Analysis of 'the overall test performance offers little 

information (;jf value td Michigan mathematics educators. ~ ^ 

» « ' » - 

It has already been reported that the Equating - Report. 

♦ ' ' • *' 

; identified* no differences on the ^mathematics tests during 

the first three of the four years. Those statistics for 

the fourth year c6mputed by MDE- showed no* gredt change 

dn that respect. . ^ * \ . » • 

, The overall level of the, performanc'e » was, predetermined 

by ETS through a calculated distribution o*f Wsy and 

difficult items. It is therefore not a direct mea'sure of 

the Equality of performance by Michigan- st^ents , but rather , 

a measure o£ the level o£ <iif.ficulty of test. 



Sinc^no other norminf^ group is available,", there is ^ " 
no^ immediatte basis for comparing Michigan •students to othfer 
students, the overall test perfqrmance data for Michigan 
districts or areas having common socio-economic cliaracteristics 
were not assembled for thi? analysis. Future analysis should 
explore the relationship between the learning of mathematics 
and such forms of educational input. " > 

ITEM PJBRFORMANCE ^ ' ^ ' 

Inasmuch as the despriptive statistics of overall test 
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performance are not available in a form* which provides 
information of general interest to the .Michigan, matkematitris 
educators, the major thrust" of th.is analysis will relate 
to the performance of fourth and seventh grade studfents on 
test items. Particularly ,• that performance will be 
examined for information which may provide sotae answers -y' 
for the following types of questions.. / 
What kind of items were 'difficult for 4th graders 
. (7th graders) ? vA . * \ 

What kind of items were easy for 4th "graders (7t] 
gradets)? . / ■ , ^ 

/ How did 4th 'graders {Ith graders) pferform on' 
collections of itejns such as: ' 

^ ^ Place value » • ■ 

, Jfumber concepts 
^^ Fractions 
. * . , ' ' Word problem's J. and • 

* ■ Si / 

\ Problems \ using algebraic eqjuafians? 
• *. * * /* •* 

Do "the tests provide *evi<^j|rice of specif icyj^^arniAg 

^ ^ problems i-n ^th and 7th' grade mathematics^? 

• " * / * 

'The analysis af performance by .many students on a large 

•^umber of tept items such as this pos6s many /problems; The 

. absence of objective data c&n be a serieus h'andicap to 
• ' . • , / 

^ decision-making but here we have sp much data th&t organizing 

'*.. . > '■ " /'■' '*' 

•it into iflieaningful components' is a challenge. While- tl^ere 

• • • • / * 

is a large amount of data aboat the-base groups there is- 

' " . *' I 

only .limited^ opportunity for comparisons between different 

■ ■ ■ . . 21 ■ f ' ■ ■ < 
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..grade^ levels between similaj pr related items-^ or bet>?e^ \ ' ^ 

- . • * j ^ 

sub-groups' o£ \studen>t^, oij .the ^ame' ite^i. . • ^i- ( 

' . 4 \ - ir ' • ' ' ^ . • ^ ' ' • 

V • ^Besides Che absence '^f .comparative data th^re are other . 

. • factors which will Hamper Ous. -effoarts: ^ 

* ^ • \ \1 • 

.1. Frequently two or tijitee concepts are interwrned in 

- . the same "item. Thatl^oses no particular .ptoblem ' * 

to the^cteato-r of tlle|nofma^ive test, but it means 

<* / ' that a student may ii^^^e missed an item in spite .'of 

the fact that" he had ^astered aM byt one of'Nche v. 

concepts*/^ It al^o is ;v^ry difficult to group, such 

^ items into, r-elated cait^ories. The specifications* 

for these" tests were cleacr-iv indentified earlier 

. ' but different per-eons assigning items to those 

' . \ categories have not agreed^ onT those assignment, 

^•♦•"^ • r '«-. and doubtless otTiers w%l^$eeii th.em still differently. 

2. Multiple response items ar:fvmad6 more .or less difficult 

Sy the n^ature o£.the pas^i^e responi.e5. • Indejexi^ 

. ^ majiipmlating the choices is a deVice used 'Fy the test 

^ ' ■ • . . , t ^. - ' ' ' . . 

.maker, to ackieve a-desi^^ed level* of difficulty for 

' ' . ^ * .'^ 

' ' • "tKe item» Once more, that Jiandicaps a person \f * v 
* ' ' * attempting to detect prograin implications from , . 

performance on the items. . • * . * • 

Zt The aormative test maker ^nust use. items appropriate^/ • .-^ 
* for the students being tes'ted*so that the resulting 
• statistics are within an acceptable range. Particular 

^ emphasis on specific ^reas is not important to Mm,. 
>. Hence, some of the more critical areas for math<bmatics . 

educators and their students are either'not * ' 



re.pre rented or are masked by item construction 
*t?chniques. On .these test's the mean4n'g o£ decimal 

:i6ns with 



fractions, ope'tat ions with common fractions, and 
ability to use the who-le 'number al-gorithms are^not ^' 
well covered/ • c ' ' x • ^ 

ThjB above, remarks are not intended to be an exhaustive 
listi>ng of the di££icul;tie^ inherent in using normative 
tests to discern 'specific strengths, weaknesses or trends ' 
in the learnjing p-^ocess. They are rather intended to put* 
the readers ,5>n guard as. they attempt .their own ahalysis and 
to place this analysis in a proper context. 

While we have attempted to exercise taution in ^ 
interpretjLng results^, it must be/recognize^ that -frequently 
the observations represent at-Tempts to interpolate, or 
ex^tfapolate «from the statistics: Since kll statements relate 
to statewide results, it has also been impossible to anticipat 
Aov individual 'schools or districts may ite'flect different. 
r6^ul-rs • * ' . • ^ 

Finally-, the deteifm^^nation. of /what is worth calling to 
the. readers ' -attention is subject to judgmental* limitations , 
The raw data are available 'thrc^ugh the. MDE and' it is hoped 
t|iat they .will, be scrutinized "for other cl^^ as to how we can 
improve instruction in mathematics, 

It is also hoped that as other professionals ^arrive at 
alternative'lnterptetations of the data they 'will utilize 
the journal "Mathematics in Michigan" or other suitable media 
to* air their vipwpointSA / ' ' ^ 

. . , 15 



With those^jA-ecbutionary .refliarks, . let examine the 
tes^.. items for informaiiion of interest. Remember^ the basic 
statistics discussed for the items will be diff iculty^evel. (0 
and i of cbrrect response. " ' • . ^, 

.DL will be a number., between 6 and 2D with an 'average DL 
for test item^ teing ^bout 12.7. DL's for more difficult 
items wil^. be higher- than -that and^ for easier tines they will 
be lower. APPENDIX C contains a table', relating DI^'s ♦to 
percentile levels. ' . 

. From time^ to time, assumptions ^will b^ made concerning, 
th^ number of students, who guessed the poy^ect responses. 
Since there w'ere'M .possihle choices for each itbm, we will 
assume that those who "knew" tl^e answer will equ^. cprre^t 



responses de^creased by 1/3 of the wtong responses. Special 
note will* be made when^Jthat is done, otherwise the percentages 
will simply represent correct responses. * 

The tests- were identified \s form S^ U, V for 1970\ 
'71, "72, and "73 respectively; hence, ye will usfe. the letters 
and'item numbers toN^identify ^n item in a particular test(s). 
UV6 would be the 6th item on both-th.^ 1972 and ^73 tests. 

Whole Number Computation and Place Value ^ 

. While there was an average of nine whol^ i^vtmljer items 

dealing with computation and'^placfe value on each 4th grade 

' * ** f 

test-, there was a relatively small number concerned >{ith 
any dne concept. Probably.the outstanding feature of student 
performance on these items was the failure of 4th graders as 
^ jiroup- to e^ccell on any .of theJn. 



t\^' two* easiest items were: ^ 
(V9) • lOxQ =100 ' 

' What 'number goes In 'the □ abovef' 



(A) 0 
.(B) 1 

(C) 10 

(D) 100 



/ 



(S5, TUV6) 



' • L Difficulty Level 8.4,871 correct. 



• 12-A,4 = 8 
■ 'What sign goes in the /I above? 



(A) + 

m - 

(C) X 

(D) ^ 



DL. 9.1, 83% 
""^ ^ 



Th,e mdre- difficult were: 

• (T9) . 



■ • ■ , 9-7'= 0-9 ' 
, number ^^tftihrtox^BbWT 

(B) 7 ' •■ • . ■ , 

■ <C) II . 
, (D) 16 ^ 



(Tuyes) 



A 

2T252* 



B • 
3T252 



4T252 



S - 



DL 17.5, 13 % 

But careless 4th graders 
selected- 5 or. 7 and the 
i^^ providied^little 
fri^ght into, their 
understanding. * 



' D 
67252 



If A, B, 9, and D are t;he,answers for- the division 
O ^ problems above, which isi the greatest? • 



^A) A 
'(B) B 

(C) C 

(D) D'*. 



25 

17 



DL 15. 7-, 22% 



(T40) 



Which ot the following numbers would be 40-more < , 
if the <Jigit-2 \vere changed to 6 ? . 



(A) i,092i 

(B) 1,129 

(C) 1,243. 

(D) 2,040 



PLUS. 7, 25% 



It will not \>e sur^grising;, to middle elementary grade^ 

teachers that when guesses ar? .eliminated tHe best that the . 

4th graders could do. on" division probl^s was/an approximately , 

,^1/3 knaw],edg©able" perfprmance! pn C^^S)':' '^j^. 
*■ ' _ ■ . ' • *■ ' ' . ♦ 

. - ■ ' * ^ ■ ' (A) 132 ■ • ' ' - . , 

• • . ■ ; . - (B) 212 • ■ ;: 

-» ' ' r ■ ' 'i, ■. • ' ■ -.(jG)-23L ■ 

" \ v;t(:D)'-312 : . -V 



23) 5175 
-4600 



» ^ , ^- •575.' 
11.5 



20Q 
20 : 

A' 



' Total quotient 

■ In the division example a"bove, the correct way to 
' fill in the spac^s^ 

(A) [460], 

-(B) H, A * . . • 

) 



(PI iM. ^ 




26 

18 



PL 15.0, 32% 



Does the hi|her performance in S30 when compart to TUV23 
aboY^^^ililstrat^ that th$,-e.ariy emphasis on division is on 
the algorithm 'and hot on its relationship to -mul triplication? 

4th grade performance on place-value items must hb . 
disappointing to teachers and indicative of a need for 
either improvement ii^^ methodology or just greater emphasis. 
Place-v^lue concepts have become very basic witli the strong 
reliance on them in more recent development for- whole 
number algorithms. Besides T40, which wa^ listed earlier • 
among the more difficult items, students performed' on 
place-v.alue items as follows: . 

^^^^ 

(V18 ) 4,271 = 4,000 + 200 +□ +1 ,. , '. 

Which goes in the □ above? 

(A) 7 . 

(B) 70. . • . . 
■ . . . (C) ,700 , • • 

(D) 7,000 ' . PL 13.5. 47% 



(STU13) 



I 

634 = 600 + □ + 4 ^ / 

What Humber goes in the box above? 

(A) 3 

(B) 30 • 

(C) 34 

(D) 63 • . . • PL 12.2, 50% 



(VSO) wilichisNOTawayofwriting387 ? ^ ' 

(A) 300 + 80 + 1/ 

+V ■• \ 



(B) 200 + 180 

(C) 200+ 170-iii7 

(D) 100 + 280 + 17 



i>» PL 13.9. 43% 
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These demonstrate rather clearly that most of our 

students were not ready for more standard approaches to 

any o£ the whole niimber algorithms. However, V30 does 

seem tx) ^indicate that som^^tudents were ready. Under- * * 

> 

.these circumstances perhaps the performances on the^ 
follpwing items, whiph measure a major part of two years 
of mathematics instruction, can hardly be surprising. 

•■(VI 2) _ (Vfs) (U15) 

-.146 . ■ 489,263 " 5O6 

\ Jl . ' 

iloi . . (B) 224.212 (B) 283 - . 

?i (C) 244.212 ■ • . (C) 323 

J^J f{{ (D) .254.314 . (D) 383 

PL 10.. 3. 741 . ■ PL 11.1, 67% PL 12.9,- 51'% 



' Perhaps the most surprising of a}l perfo^fmances by 
fourth graders in tl^ese items was on^' 

♦ 

4 + 4+4+4+4 = 0x4 . ^ • ' 

Which number goes in the □ above? 

(A) 4 

(B) 5 . . ^ 
■ (C) 20 

(D) 24 •* 
' ' - PL 14 :S, 37^ 

Imagine 1 Less than one in .four 4th graders demonstrated an 
understanding of t"he association between multiplication and 
repeated addition. Assume that the 20% who selected "(C) 20" 
were careless and knew the correct response. *^Ven then, 
after discarding guesses, only about 1/3 do understajid the 

28 
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relation. What does it mean, then,- when SS% correctly 
respond to (U24 ) 3 x 604 = 

(A) vl92 

(B) 1,807 

(C) 1,812 

(D) 1,912 

There were 40% who "knew" the correct response. Could 
• they make use of knowledge so lacking' in background? 

Perhaps better than any other group of items these 
'illustrate the enigma of the middle elementary grades iij 
mathematics education. So many concepts included in 
.the program are appropriate ^ot some students.' and not for 
others. The need to Veach different concepts*to different " 
students in the s^me classrood, i.ev differentiated, 
instruction, is very strong.. It makes little sense to try 
to teach the algorithms to youngsters who dq|^ot have a v 
•basic background. Yet the dominant instructional^ mode is 
very likely that ^of taking the whole class page by page. ' ■ 
There is little wonder that many starry-eyed second graders 
who are intrigued by numbers turn into sixth graders who 
sJyaway froia them. . . . . • ' 

Perhaps because the 7th-grade t^x,ts and "programs have 
tended to move on to other things the group of .whole number 
test items is less. extensive for 7th graders. Questions which 
many '7th-grade mathematics teachers" would' have liked to have 
included, such as two and three digit multiplication and 
division, were not as^ed. Those which are included indicate 

I - * 

that the basic weaknesses cited, for 4th. graders are stiil. 
present in* the 7th grade.* 

- ^ 21 



(S|5 UV12 ) 70,060= , ^ 

(A) (7 X 10,000) + (el 10) . 
■ (B) (7 X 10,000) + (6x 100) 
(C) (7 X 10,000) + (6X 1) 
. . ■ (D) (7 + 10,000) X (6 + 10) 

' PL 9.8, 79% ' * 

Because of the nature of the choices, that item established 
•that 1/3 of the students could not correctly identify thfe 
place value of the "6". • . / 

(ST17 , U28) ^ □ + ^ = 9, where □ and A are whole numbers, 
* which 5f the following is true? ^ • \ 

(A) 94;a = A 

(B) 9 - A =□ 
(c) 9+,A =□ 

^ (D) □ - 9 = A , 

PL 12^5; 55%' 

' ^ 

' • , ■ - ■ ■ f 

(T12) 25x8= . . / 

(A) (25x6) x2 ' : . ^. ■ 

(B) (25x5) X3 ■ ' 
(<:) (25 xi) xj_'^ 
(D) (25X4) X4 




(S13) 21X32 = 



(A) (20 x 32) + (lx32) 

(B) (2x32) + tlx 32) 

(C) (20 x 30)'+ (1x2) 

(D) (2l\30) +(2 x 30) 



PL 13.3, 47 

\ ^ 



(UV6) - ^ . 



4 remainder 
InAcdivis^n p^blem above, the 
number that goes in | | is 

(A) 4x62 

(B) 6x62 

(C) (4 x62) +6 

(D) (6 x62) +4 



PL 11,1, 6Bi 
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(STU8) * If 36 - (n X 3) '= 0, then n = 

(A) 4 ' . 

(B) 8 ^ 

(C) 12 

(D) 33 ' 

^ . PL 10,9. 70% 



Peducting for guessed, the best succe^ on these items 
was -just over 2/3; the average is. about 1/2, They are all 
related to a meaningful 'use of wSmh^rs. These performances 
"cieaTly indicate that a large grojup oF Hidxlgan 7th graders 

« 

are not very facile with whole number concepts^ Again, 
implication* for differentiated mathematics instruction at 
7th grade and some modification of elementary programs are 
inesckpable* 

Questions related to multiples of Whole numbers 
constituted the balance of these whole number items for ' 
7th graders • Around 2/3 of the 7th graders demonstrated 
familiarity witJC the concept oi "multiple" as in: 

c 

31 . 

-.23 ■ 



(V8) , ff X is a multiple of '21, it musj also . 
• , be a multiple of ^ ^ 

(A) II • . 

(B) 7 ' 

. (C) 5 . 
. (D) 2 ' PL 10.7, 75% 



However, two other quesl^ions concetnijj.g common multiples 
were found to be so difficult* and complex that they were 
not informative; i.e., ^ 

(ST29) The least common multiple of 6, 8, 18, and 30 is 

(A) 1 ' . ■ 

i O) ' 2 

(C) 18Q • 

(D) 360 ■ . 

PL 16.5. 20% 

Properties of Whole Numbers and Their Operations 

Items treating the special prcJperties of zero and one^ 

and whole number operations are 'examined together in this 
- • * 

section. " , 

• ^ ^ - - - - __ __ __ , _ _ _ 

While nearly all (93%) of the 4tii graders used zero 
correctly in (UVl) 13+3+0= • \ 

(A) 'o . . ' 

(B) 10 

i • (D) 17 

cmly.2/3 could generalize the role of zero in addition 
to (TUV3) 7 ^ □ = 7 . . • 

What number goes in the box above? 

(B) ^ 



(C) 1 • V- . 

24 



2/3 of the 4th graders could also, generalize multiplying 

bv "1" in (S2, rs) ^ * 3xD=3 . • 

' . What number goes in the box above? 

- • . (A) 0 

* ■ • (B) 1 

% (C) 2 f 

. . .{D)3 ^ 

Since it se..s very likely that nearly all 4th graders ' 
.^ow that "5 X 1 = 3-'and "7 . 0 = those last t.o ite.s 
see. to indicate that I/S of the 4'th graders are 'confused 

by "box". ' •■ ' \ 

A related question (U9) .84x0=84 
. What number goes in the a? 

<A) 84 

(B) 83 • ■ 

(C) 1 , - . 

(D) 0 

t vas responded to correctly by 50%. of the 4th graders, 

suggesting that- there was still another group who understood 
^ t-he us. o'f the "box", and'that x 1 = 3", ^ut had not . 
formed the generalization "N x I =^ N". 

Consider (V26( for 7th graders : ^vhich is true for all numbers N ? 

' . (A) N-2 = 2-N 

(B) N+0 = 0 • 
{C)Nx>I=2xN — 
(D) NX 1 = N 

Since 7th graders selected x 1 = N at a 41» rate, it 
is likei^ tha't not more than 1-/3 of the 7th graders had 
formed the generalization for multiplying by 1. • 

• About 1/2 of the 7th graders able to respond correctly 

to f SIS) If V = i:'">l* <''"•'<'"""'« 

' sions equals I ? . , 



(A) x + y (C)- 

(B) xy . (D) \ 



33 



» ■ * ■ 

90% of, them respoiided correctly to .(V4) if 7xn=0, then n = 

(A) 7 
• (B) 1 
(C)i 



and to (SI, TU2) 



(-D) Q 

^+ N = 7 and N is a number, then N 



(A) 0 

(B) 3 

(C) 4 

(D) 7 



V. 




J 



These three items point to the pesky im^re of -z>cj»^and 

one for both 4^ *and 7th graders, the gen^^lizations may 

be mastered quickly by some, others are at leas^ 

periodically unsure and some just do not. know. 

Two items, covered the commutiative l^w ^or addition^ 

(ST16, UV22 ) 23 + 4 = 4+D 

What number goes in the □ above? 

(A) 27 • 
MB) 25 ^ 

(0 24 - , - ^ 

■ (D).23 ' 



(UV5) K 24 + 75 = 75 +N, then N = 

(A) 0 
•(B) 12 

(C) 24 

(D) 48 ^ 



\ 



They wfere answered correctly by about 6^% of the 4*th graders 
and 801 of the 7th graders respectively. 

^o more items rgjpated to -the dis.'tributive law: 

• 34 ■ • 
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(STUV27) Ax 9 = (5x9) +(3x9) 

1 

. What number goes in the A above? 

(A) 2 ■ 

(B) , 8 

(C) 9 . 
(DI 15 



(S13) 21x32 



(A) (20x32) + (1x32) 

(B) fS^ 32) +(1x32) 

(C) (20x30) +<lx 2) 

(D) (21x30) +<2x30) 



They were managed by 38%-of the 4th graders and 47% of 
the 7th graders respectively • - ^ . . • - 

(T29) Which is twice (8 + 8) 

• • • 

(A) 2+8+8 

(B) 16 + 8 

(O - 4 + 12 • 

(D) 16 + 16 . * X t . 

.received a 45% correct response from 4th graders. ' 

Thus, in spite of textbooks which stress these basic 
niimber relatiohg, a large pro^j^rtion of our s-tudents have - 
not mastered them by, the 7th'^rade. They appear to provide 
a very shaky basis for the teaching ojl^omputational 
algorithms. 

A question involving an application of the concept ' 

•'average*' was one of 'the most difficult* on. the. entire test- 

(STUV30) If the average of S integers is 12 apd the sjlm of . * 
, 4 of the integers is.S2, then, the Sth integer is 



(A) 8 

(B) 12 

(C) 40 

(D) 60 



35 
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There is only the ^slightest statistical assurance that 

any 7th grade students responded to that t^uestion 

knowledgeably. * . " * 

* • J* 

Fractions . 

: ' / <^ * - • ^ . • 

By .January of their 4th grade year, many students have 
had only limited ^xperi^hce with fractioi>s. There is > 
some rather strong sentimen^ that the major emphasis at 
that time .should be on improving proficiency with the 
whole number algorithms. In many cla^se^, fractions tend 
to-.be given a cursory treatment late in the year." 

One might hold that 4th graders should* study the 
mathematics for which they are ready. Is two-digit 
muj^tiplication easier or mor^ difficult for 4th graders 
rthan the introductory^ concepts related to fractions? 
We have already seen that ah uncertain knowledge of place 
value and other number properties makes a meaningful ^ 
introduction to the multiplication algorithm doubtful o for 
at least half of the 4th graders,* Does performance on 
tfeese introductory. concepts related to fractions suggest 
that greater attention to inactions at .the 4th grade level 
would be more Jtimely? Have we devot.ed too much time in 

■ 

the 3rd and 4th grade to larget whole numbers and too littl 
to the siinple fraction concepts? 

Three test xtems asked .students to associate fractions 
with geometric regions. . ' 



• 36 

28 



(TUV34 ) vVhich square has the greatest part 
shaded? 



/ 

(A) 



(C) 





(B) 


















• 










"1 







PL 11.5. 70% 



(S21) 




What fraction of the figure above is shaded? 



rA.)| 

(B)| 
.(D) i 



PL 13.1. 50% 



(TU28) * Which figure is NOT _| shaded? 



And ^ive others with some other. form of meaning of 

fractions: ^ . ' 

^^22^ Which set does NOT have ^ the dots 

shaded? 

' (A) 



O O 

(6) o d 

•'0 

' (c) 0 0 0 



J 



■J 



9 • • • 



o o o 

(d) ■ * #10 

o 



\ 



0 0 0 
' .1 



(U3 8 ) In which set are • of the stars circled 
(A) 



PL 13.3, 49% 



(B) 



(Q 




PL 18.0-, 12% 



(S24) 



6 is J of 

(A) 18 times 6 

(B) ' 9 times 6< 

(C) 6 times 6 

(D) 3'times6 



t • 



--7 



•PL 12.5. 56% ' 



(S29) 



t 



The arrow above points to a number named by all 
the fractions in which of the following sets? 



^^^4"^' tI} 



(S9) 

If 4 sticks are each cut into fourths, how many 
pieces are there? 

(A) . One * 

(B) ,Eour 

(C) Eight 

(D) Sixteen 



PL 1^.5, -28%. 



r ■ 

PL 12'. 4. 5.6% 



Assuming that 4th graders have' not had an extensive 

exposure to "fractions, the following observations appear 

to eme.rge from that collection of items: • • . 

Fractions related to regions are easier £otH4th 
graders to understand than when they arfe related ■ 
to sets. (Compare 521 to U38). - / 

Fourth gtaders have a strong intuitive^^rasp of J/2 
^ ^as^ indicated by the •strong performance* on V32. 
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' The set interpretation. of fractions appears to represent 
a stumbling block (compare S24 and U38),' This is 
pethaps .because the basic unit to .which the fraction 
applies: is more obscure in a set than it is iii a rtegion; 

It is unfortunate' that^ S29 was complicated by the concept 

of equivalent fractions. One would like to belieye that " 

having identified the point as "3/4" 'students, would have 

seen only one correct choice but" a^low correlation to 

performance on thd^'rest of the test '[ .16) and other items' 

statistics suggest .confusion. "-.The only ptheip item" which asks 

-• ■ ' 

^th graders to associate fx^cticins< with the number line CT38) 

N, 



[T38) 

' I 1 H— t 1 1- 



H Kr 



Oathe number Une above, is halfway betwee^n/ * 
1^ and. What do ydU add to 1^ to get N ? 

• , ' . (A) 1 . " • • , ■ • ■ • • . 

^ ^ . . « .5 .... 

■ ■ - * " " ■ ■ ■ • 

was impossibly complex and offered no add"|tiop,kl insight. 

It IS interesting to riate that one of the few , items 
on the te^t on which there is solid eyidence of change over 
the four years of testing is (TyV34)' (p. 29) on Which 
performance in successive years ,,imggpved frx)m 66% 'to 76,%. 
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(T36, UV35) Studehts are ask^d^to give meaning to mixJed, numbers 

4 . - - ' 

' (A) 7 + f 

(C) 7 X I 
4 

■ (D) 7 - 1 PL 13.6,. 45% 

• 4 ^ 

There are a niunber of complexities in that* item and it is 
surprising to find that (DL 13.6, 45%) one-third of the 
4th graders are that knowledgeable ffbout mixed numbers. 
. ' The weakness of using a norm- referenced test for 
facilitating instruction stands out <^Yearly in the items 
on fractions used with 7th gradets> There is so much specific 
information which would haye been useful^ but the itea 
selection did not pTovi4e a ^asis for getting that information. 
An item (STUV3} Which statement is true? ' ■ * , 

J - : ^. - ■ .. ' . 



(B) i>| 

(C) \ > |. 



<°^i>5 .; ■. /PL 10.5, 72% 




deals with size comparison for unit ffactions but there is 
,no follow-up for nonunit fractions.. A single question .(V7) 



Earch of the foUcrwing Is equal to 
^EXCEPT t ■ 

'«! ■ ■ . ■■ • 

(D)-^ PL 9.9. 801 - 

deals wJLtlj equivalent fractions but the fraction involved 

is 1/2, one with- which students show such strong intuitive 

'indent if icat ion that the 801 performance tells nothing 

about an under st and ingr of the generalized concept. 

In spite of interfering factors fn two of them, these 

three 7th grade items do provi4e some meaningful information 

abojut the effectiveness of instruction: ^ 

^V36) ■ 2 1 _ 

6 3 - , • 

■ • \- * ^ 

' - ' (^)ll - . • 

3 ' " ' 

(B)| • . . 

1 

, • 2* ^ PL 14.8. 32% • 



(U26) -1 1 1 ^ 1 _ 



(C) 1^ 

(D) l| 

V 



42 • PL. 15.^4., 46% \ . 
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(V40) l^i 



^^^f2x7)-(8x4). 



7 - 1 



(C) 



8 



7-1 

^^^8^ f>L X4..8. -53% ' 

4 

Each of these items was used on just one test. That 
provides a very unsatisfactbr]^ look at 7th graders' ability 
to compute with fracti^sl Performance on these items 
speaks fox itself. Michigan 7th graders are very weak in 
the addition of fractions with unlike deno««jiators and are 
probably also weak in subtract in:g them. 

Two items related simple fractions directly to decimals 
.One (tU20) 2 + 2^ = 

(A) 0.43 T ■ , • ^ 

(B> 2.25 

(C) 4.05 . . 

{D)4S. ■ '. " ■ - - - 

required the students to represent "2 + 2 1/2" as a decimal 
and another (S7) ^'^I'' ■ 

(A) .15 

.(B) .5 ■ 
• (C) 1.05 
m (D) 1.5 ' > « 

required the same for "1 + 1/2". Average PL for these .items 
was about 12.0 with 60% xorrect rSspQnses. In other words, 
^boirp half of the 7th grad/rs tested "knew", how to represent 
1/2 as a, decimaL .^ractioji* Ab6ut-"the same numbet were able 

A. . ■ ;.■ ■ ; ■• . 



to manage '(UYIQ) 200.1 - 199.0 
"\ » 

(A) 1.0 
. (B) LI 

(C) 10. r 

(D) ILl 



Large numbers o£ Michigan 7th graders dp not.h^ve even a ^ 

minimal ability .to work with decimals; but the nature 

of the rtents and the percentage of cortect responses is 

such, that' there are likely to be large differences among 

districts' in the performance of students in decimal 

fractions • . » 

The test makers put unusual stress on the concept 

that a number multiplied by a fraction- could be less 

than th6 number itself. They administered 3 items dealing 

with -that concept a total of 7^ times and discovered that 

perhaps 1/3 to 1/2 of the 7th graders w^re aware of thiis 

or could deal with multiplication in a way which permitted 

them to make accurate deductions about the rtelatxons^ 

iSTirhz) Karen says, "When I multiply any^ 

number 1^^ 2, the answer I get is ' ' ^ ' 

always 2 or more. " The answer . . ' 
to which of these problems shows ' 
Karen is wrong? 

* • * 

(A)2xii . ^ ■ . 

<B)2iil ' . ■ ^ . 

(C) 2 X i ■ 

,(^)2x0 PL 11. a. 62% . 
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(UV38) If 300 times a number N is greatefr ' . ' 

* tiian 300, rhen N could be . i 

(B) 0.888 \ • 

(C) I ) 

(D) 8 • • PL 15.6. 46%^ 

« 

(T38) For wffich of the following does n represent a " ^ . 

" number greater than 300 ? 

(A) 300x| = n 

(B) 300-^ 2.3 =n 
fC) 300x^1.2 =n 



( D) 300 I = n 



PL 15.0, 55% 



£ollectively these, items -seem to indicate that most 
7th graders have no^ achieved the ability ^o make these- 
kind of comparisons. They suggest that 7th graders* "feel" 
•for numbers of this type is not very' strong. 

The most difficult "item in this "section for 7th graders was 
"^"^^^ ^ If 82 =0.082, then N = 

(A) 0.001 ' ' . . • ; 

(B) 0.01 3? 

(C) 100 * . . 

(D) 1,000 . . ' , 

PL 17.1, 17% 

Perhaps its placement as the last item on the test had som^ 
. influence on the outcome, but on face valu.e, and particularljr 
when considered, with TU20, S7, (p,35) and UV19 (p.*36) it 
ai)pears to point to a severe breakdown in the development of 

• 45 
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decimal fractions concepts . With th« present emphasis 
on metric measurement, *it most certainly demands more 
attention. ^ . 
The comparisop o£:' 

• * 1 



(A) 2x3 

(B) 3 x3 

(C) 4X3. 

(D) 6x3 



PL 10.4, 74% 



to S24 (p. 31) for 4th graders is perhaps worth noting. ' The 

7th graders had the advantage of an intuitively more 

familiar fraction, but their performance advantage (181) is 
• \ • 

small enough to conclude that this concept was not stressed 

(, 

in the intervening years. ' ^ 
Measurement " • ' 



>. A large niimber. of items applied to the. general area 
of measurement. 8 items collectively a^eared 16 times on 
tests for 4th* graders, ^^d 17 items appeared 30 times on 
testa for 7th gradelrs. That is an average of 4 items per 
test to 4th graders and 7 items per't-est for 7th graders. 
But the number of :j.mportant concepts in tHis area is also 
great, so only linear measurement received fairly detailed 
attention; othfer measurement areas were barely touched. 



ERLC 
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Linear Measure 
(T33) . . 

\ I 1 I 1 I I I ^( 1^ I I I I 



J M I 1 I i H I I 1 i I 



\ 0 • 10 20 
\* 

On the number line abov^e, the arrow points to 

■ Ca)\ 

« (B) 15 

(C) 17 

(D) 25. 



77% Of 4th gr^ers correctly selected (B) for that 
question. When the stale was terminated at 20 (UV21), 



/ 



(UV21) * , ^ 



i I I I I I I ! I I I 'l I iNj 



1 1 1 1 1 
10 20 

On the scale above,* the arrow "points to 

" . (A) 12 , , . . 

(B) 15 . • • . 

•(C> 17 

(D) 25 , • 

♦ 

the percentage for the, same ^question increased significantly 

to. 83%. Not a great change, but why should the open-ended ' 

. ' ... 

scaje ^eep 6 students^ in evexy 100 fxom.^ucG«ed-i^ig^? • 

S29 (p. 31) was discussed earlier with fractions. It 
indicated that the use of fractions on the number line ^xth 
.4th graders should be approached very, cautibusly. It also 
suggested, that expecting the average 4th grader to measure, 
dist'ance to quarter units is not Very realistic for many 
Michigan 4th graders. 

Another perceptual problem in linear measurement was 
encoimtered by 4th graders when asked to respond to: 

47 . ' ' 
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(ST15)' 




This plant is next to a yardstick. About how tall 
is it? 



( a5 Almost 4 yards tall 
(B) Alnriost 4 feet tall 
(C> Almost 40 inches tall 
(D) >\Imost 4 inches tall 



PL 14.5, 36% 



About 36% responded correctly. Discounting guesses, 
about 1/6 of them were able to perceive the fact that 
the 2 1/2 inch scale^wafs intended by the adults to be 'a 
yardstick. ^ Very few appeared to be 'distracted >by 
di^t4.ngui"Shing^ 4^ inches from 4. feet. 'The m.es^age seems 
c^ar.^ 4th graders will have a tough enough time measuring 
in the real wgrld; don**t ask them to visualize a yardstick 
shrunk to '2 -1/2 inches. 

Interestingly,, on this map, a few more studen'ts 
were able to' identify the correct response for the 
distance fi?om Penn-City to Newburg. 
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(TU3. 



12 Mil&s 



City 




10 Miles _^ SeIma 



Queens 



On the map above, what is tiie distance 
from Ftenn City to Newburg? 

(A) 12 miles 

(B) 18 miles 

(C) 20 miles 

(D) 30 miles 



PL 13.7.. 451 



Andthe lorrelation to performance on the rest of the 
test waslsignifica^ntly better. Perhaps this was because 
they had liever seen a milef^^ ^' , 

.Nearly 3/4 of the 4th graders' could dorrectly 
identify jhe perimeter of thi^^triangle , but fewer than 
^half could <.t ell how> much wire it would take to maHe the * 
square. 
(ST12) 




CUVll) 




2- incKes 



The perimeter pf the figure above is 



(A) 10 

(C) 25 

(D) 50 



PL 9.8, 79% 



Hbw many inches of wire would be 
needed to make the square above? 

(A) 4 inches 

(B) 8 inches 

(C) 12 inches 

(JD) 16 inches 
»' 'J 

, PL 12. 57% 



Th-is could indicate that while they recognized tjie square, 
for many cE them it diti^not have equal side^* Or maybe 
they just Couldn' tHcaagine that the side, -which appeared 
to be 1 iijph, was a,ctually 2 inches in length. 

49 ' ' 
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Seventh graders displayed a similar problem. 
Nearly 7/8 .sf them correctly identified the perimeter of 
a given triangle (-^10) 




The perimeter of the figure above is 

(A) 11 

(B) 13 

(C) 18 

(D) 30 



but less than 1/4 responded correctly to-: 

(TU18) Yf the perimeter of* square is 36,^ 
. _ then tfie length of one side is 



(A) 6 

■ (B) 9 

(C) 12 

(D) 18 



V 




■5 



Even though the alternatives were 'not very^ attr^slctive , - 

only 1/4 of the 7th graders^ correctly* gave the perimeter 
* 

of the parallelogram: 
(S21) D • 




In the figure above, what is the perimeter of 
paralleJogram- ABCD ? 



(A) .19 

(B) 31 

(C) 38 

(D) 84 , 
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This seems to indicate that the characteristics of 
^ common geometric figures^ do not come through very 
strongly in the JC ^ 7 mathematics program'. 

While 70% of the 7th graders responded correctly 



to 



\ 



CSTUlO) 




If each small square above has an 
area of 1 square inch, then the area 
of the fehaded region in square 
inches is ' 



1 



(A) 3^ 

(B) 4 

(C) 5| 

(D) 6 



a question calling for them to determine the area of a 
polygon displayed on a grid, only 60-% could tell: (V20) 

(V20) Of the following rectangles, which 
has the greatest area? 

(A) 



(B) 



8 ' 



(C) 2\ 



(D) 3 



10 



5 
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And finally on (137) fewer than 1/4 managed. 

CT37) What is the greatest number of squares of cake 
2 inches on a side chat jane can cut from a cake 
15 inches by 8 inches if the thickness of each f 
sqbare is the same as the thickness of the cake? 

« 

(A) 21 

(B) 28 • . . 

(C) 32 

(D) 34 ' 



In Other words, only the best Michigan .7th graders 
are functional with the area of simple rectangles. 
Fortunately, there were no area questions covering 
triangle, parallelograms *or trapezoids.* 

The balance of^ the measurement questions for 7th 

r 

graders dealt with units of measurement. .There were six 
unit conversion problems : . , 



(ST9) minutes to hours--76l 
How many hours is 150 minutes? 
(A) 2 



(B) l\ 

(C) 3| 



(D) 5- V 

(TU15) dimes to nickels --64% 
24 dimes are equal in value to 

(A) 480 pennies 

(^) 48 nickels ' * 

(C) 12 quarters 

(D) 5 half dollars 



52^ 
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(TUV34) gallons to quarts -- 54 

. Which of the following l-gallori cans 
contains about 1 quart? 




\(C) 



(ST27) feet to inches application-35% 
How many quarter- inches are in two feet? 

.(A) 96 

(B) 48 

(C) 24 

(D) 4 • 



(V13) decimeter to meter (given 1 meter = 10 decimeters) --63% 

One meter is equal to lO^decimeters, 

How many meters are equal to . 

80 decimeters? ' . • " * 

(A) 800 * " ■ • 

(B) 8 ' . . . 

(C) 0,80 ■ « 

(D) 0.08 - . 



(121) pound to ounces application- -36% 

How many 8-ounce packages of hard candy can be 
made from 2^ pounds of hard candy? • 



(A) 3 
(R) 4 
(Q h 
(D^ 6 



,ERIC 
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Together they indicate that about, one -half of Michigan 

\ 

7th graders are not comfortable with the more common units . 
of measurement. Even the dimes to nickels conversion of 
24 dimes to 48 nickels coni^^ised more than 1/3 of them. 

This item was answered correctly by 53'% of the 7th ,^ * 

graders . .(UV29) ^ ^^^^^ 20 minutes 
• • -1 hour 35 minutes 

(A) 2 hours 15 rainij^s ^ 

(B) I hour 4^/minutes^ ' - 
* (C) 1 hour minutes 

(D) I hour 15 minutes 

When compared to the conceptually easier problems in the 
last paragraph,^ one can only conclude that not much time 
is spent in Michigan schools in teaching students to use 
units of measurement and that they do not pay much attentioii 
to thea .outside of school either. One would suspect that 
without schooling a 7th grader would be able to-^^11 
which of four partially filled 1 gallon coTitaii\ers contained 
1 qu-art, but fewer than half were abl« to an thiBse tests, 
(TUV34) (p. 45), ■ ■ 

One of the most difficult measurement questions for 
7th graders was a proportion prohlemV' / 
. (U40) A , B , C ■ \ . ' 



In the figura above, if the length of 
segment AB is 12 inches, then the 
length of segment AC is 

(A) 18 inches 

(B) 24 inches 

(C) 30 inches 

(D) 36 inches 
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So feV^tudents^knew how to deal with that proMem that > 
• ' ■ ' • * . • .. 

it -woULd not be possible to statistically establisli that-' 

anyone "knew"^. . Yfet students .-dld..^espont^. at the -^4% level;' 

to : . ^TU4) \i 5 inches on a "map represents ' " ' ~ * 

120 ipiles.^-how many miles does 
• ' 1 inch represent? . - 

'•' ■ . 0' - ' . • • 

(A) 600 . / 

• ■ (B) 125 ' ' ■ * . 

(C) .115 , • ■ ^ , • ' 

(D) 24 



There was also a-'.Tath'er' strong -perfoxinance (59%^onV2l) 
in another problem requiring dird\t use of a scale. 
■ ; (V21)- A^par , - >• 




'Scale: 1 inch - 3 males 

• On the ma^ above, *the length of the 
segment connectmg A6par a'tid Bor 
.is how many inches? , 

'•(A) 2 ' ' ' . ■ • 

(B) 3 . • 
. (C) 4 . • ^ ■ ■ 

(D) 5 • 



This group of problems concerning measurement" tend 
to make" it qUite clear that Michigan mathematics programs- , 
either do not stress otr axe not particularly effective *in 
thexT stress on measurement and other related topics' which 



apply numbers to geometric*^ £igures/('si'fetri^ * 
This i's one'^of the most' 'obvious. -a^e^s; practical 
meaning to nximbers. " •S'lrice' -th^t* has' se'^e<J'.to be a general 
Weakness in modern mathematfics programs, and with the 
more recent emphasis on career education, it appears that 
this area of instruction does need consideqrabl'y more 
.attention. 

Geometric *pyopertie^ of Figures ^ - 

'J • ' ' • ' 

Geometric properties of various figures were covered 

f . p ♦ 

by 3 items. which CQilepti^vely, appeared 5 times on 4th 
grade tests and 6 items which appeared 9 times on 7th 

grade tests an annual average of slightly over one 

* » 

^tem'per test for 4th graders and 2 items per test for the 

7th graders. ^ The results are correspondingly spa^sTt^-— 

At tKe 4th grade level: ^ z - ^ , " 

•-90% of Students selected a triangle, from a number. 

of pl^ne fi^ur^s {SI, T2, US3 

--80% of the student's identified points which were 

inside both of an, overlapping s^fc<are an<! circle (TUVS) 

-7Ab6ut 50% correctly picked a shortesT'-Tiistance between 

«to • • • 

t'Wo points on a gridy^26]t 

the 7th grade level i 

• I 
--just over 50% correctly selected a polygon (square) 

which had parallel sides (UV23) 

--^oi|t 33^ correctly identified- a diameter as^a line 

» 

• twice fs long as a ratJius (ST16) 



^ --about were able to manage a rather wordy problem 
involving distances ,apd direction on a gridded map 
(ST23, V27) ^ . • 

Perhaps the outcomes most worthy of noting here are 
the failure of the mathematics program (l*-7) to deal 
effectively with parallel and the radius/diameter rel'ationship 
These are so obviously within the experience of these 
students that one^onders whether the more abstract 
geometric concepts investigate'd in m^y elementary mathematics 
books have hidden relationships which are easily within the 
students' grasp and perhaps far more useful to them* -These' 
books may even imply that a geometric relationship is not 
considered iii^eful or significant linle^s it is couched in 
proper mathematical term^* 

The facility of both 4th and 7th graders to work on a 
gridded plane is very interesting and could be. useful. It 
is qbvious that in many respects the regularities within 
our cities and buildings does result in students living in 
a* gridded world* the geoboard attempts to capitalize on 
this. Perhaps other concepts like perpendicularity and 
parallelism should be taught through the use of the geoboard. 

Formulas and Graphs i^ 

The use of algebraic expressions in a formula to 
generalize methods for arriving at certain values-^ such 
as C = iTiX or V =5 Iwh, or to desclxibe relations such as ' 

: 57 ' 
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3 C 3C 

b ^ d EcT directly explored by these . tests • 

However, three items did examiae the ability to 
substitute numbers into algebraic' expressions to determine 
values. Results on these items showed that, despite 
general student familiarity with the operations involved, 
well over ^ half of the students had difficulty with such 

substitutions. 

Ik 

in the 4th grade this was true for (STUV19) 2 x k, 

and in the 7th grade for (TUVll) a x .b and (S2) 1^ 

c r 

This seems to imply that textbooks which have relied heavily 
on such expressions to describe relationships tend- to 
reach only the better students . 

In e'xaminiiig students ability to work with graphs, tests 
of this nature tend to be 'restricted to items which requi'r^ 
■an interpretation of existing graphs. The construction of 
a graph i^volves different skills .and it seems probable 
xhax many students are likely to be able to interpret 
graphs which they could not .construct . 

Since these tests were not different in that respect 
the results are probably somewhat optimistic about students 
ability to work with graphs. Bar graphs, pictographs and 
line graphs were examined at the 4th grade (3 items) and 
circle graphs were added to give a total of 7 items at 
grade 7.. Except for a 72% score on a very simple pictograph 
(V20} at grade 4, the results for the 10 items, which 
collectively appeared 15 times, were surprisingly consistent. 

58 
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The minimum correct response percentage was 421 and the 

maximum 62% indicating that between ^/4 and 1/2 of the 

students were able to interpret the graphs. We must therefor 

believe that not over 1/3 of our 7th 'graders are able to 

construct such graphs. Ability to interpret bar graphs 

was only slightly stronger than it was for circle graphs. 

Since the ability to interpret graphs appears on 

nearly ev'ery list of functional co\ipetencies and since it 

increases in importance* for individuals as their use of 

mathematics grows, this should be an area for concern". 

J 

Unless great stress is placed on this area in later 

instruction it seems likely that most consumers will not 

be even minimally competent in this area. The fact that 

it needs attention is not likely to surprise mathematics 

educators. This is perhaps an area 'in which mathematics 

instruction might profit by greater cooperation with other 

curricular areas, such as science and social studies. 
A ' 

Equations and Inequalities 

At the 4th grade level, \the findings on problems 
involving equations and inequalities are frequently 
inconclusive. As with word problems, it is sometimes 
difficult to determine whether the mathematical concepts or 
^the equation format represents the difficulty. 

On the test placeholders (cd , A ,• etc.) are used in . i 
equations to represent numbers or operation signs. Some 
evidence that the^e are not particularly confusing can be 

59 
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seen in these ■ twcJ» problems . 
(ST5 US' V6) 12 A 4 = 8 

What sigfi goes in the A above?. 

( A) > . 

(B) - 

(C) X . 
. (D)^ 



(V17) • Kim dropped a dozen eggs. If 
seven eggs were not broken, 
how manviwere broken? 

4 

Which number sentence can be used to 

solv# the probleqj above? 
> 

(A) 12-'7 = □ , ^ 

(B) □ - 7 f 12 
"(C) 7 -r 12 = □ ' 

(D) 12 = 7 T 



Sl% and 70% respectively responded correctly to these 
items. Since the second problem also has some format and 
language difficulties not present in the first, it would 
appear that the equation form of the responses to the ' 
second 4id not represent difficulty* 

It is interesting 'to note, however, that "in item 
(STUV19) which uses a lefter to^represen't a number, the 
si'tuation was quite different, 
(STUV19) 1^=4, then 2xk= • ' 

(B) 2 . ' ' • ■ V 

^ . (0 8 



(D) ' , ^0 



.52 



Actual correct responses to that item was about SOI. 
Indicating that roughly 1/3 of the students dealt with' 
it knowi^edgeably: • Since other evidence indicated that 
at least 901 of the 4th graders knew that 2x4 = 8, 
it. seems quite clear that only the best students were 
comfortable with the use of "k" in that way. This seems 
to indicate that the expression of concepts in terms of 
letters should be used very cautiously with 4th graders. 

^ In the area of iftequalities there is an interesting 
comparison between two approaches to the ">" condept. 
(UV2) -Which" is rhe greatest? 

(A) 98 

(B) 89 

(C) 888 . • . 

(D) 908 

90% correctly, selected (D) . The' 90% indicated that 1/8 
of the Ath' graders still need remedial help in this area. 
ClearJiy they are not ready^ for the multiplication and 
'division algorithms, it is also interesting when ,compare<; 
to (ST8) to which less than 1/2 responded knowledgeably. 

(ST8) Which statemenUs true? 

(A) 145 > 155 

(B) 125 > 125 

(C) 1.35 > 145 / ' • • 

(D) 155 > 135 ^ 

'Ab6ut half of the sta^cents fell victim to the words 
"statement", "true", and ">". A 70% correct tesj^se to 
(VIS) Which statement is true? 

(Ai 9-^*3 

(B) 9-6<3 

(C) 9-6>«3 • 6i 

(D) 9 - 6 = 3 ^ • , ' 

■ S3 • • 



indicates that a sizeable group of our 4th graders are 
confused by the symbol 

By the 7th grade a 7-2% gave a correct response to 
(STUV3) wT^ich statement is true? 

(C)i>f 



That seems to indicate that by gra^e 7 is primarily 
/a remedial problenr. 

A 90% correct response by 7th graders to SI, TUV2, 

. If 4 + 3 + N = 7' then N = ? . ' 

indicates that 7th grade students are not completely* 
uncomfortable with the use of letters. 

However a 48% correct response to (TUVll) 

a = 3, h = 8, and c = 4' then 5LiE_±-.= ? ' 
... c 

and a 44% correct response to (S2'9 

If k = S and- r = 2 then 2Ji = ? " 

r ■ • ' 

\ indicates that letters must still be used with great caution. 
Using 'letters as a means of expressing' a r^ationship or, 

_ making a definition, as is common at the 7th grade level, • 
could be confusing to nearly 2 out of every 3 .students,. 
That is enough of a problem to ban the use of letters for 
such' purposes at the 6th and 7th grade level unless it. follows 
"' a long develbpmen^l process through which the relationship j 

• / 62 ' ~ 
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has been internalized . In 1935 Harold Fawcett commente<i 

on that pr9blem in Mathematics Teacher: 

. j . . • 

^ "Behind ev^ry symbol is an idea. It is the 

idea which is important and it is familiarity 
with that idea which pups life ^nto the symbol. 
It is, therefore, of greatest importance that 
the idea be identj.fied before it is symbolized ,"(20) 

That appears to be a very appropriate caution for "modern 

mathematics," \k . ' 



Word Problems 

• The, summary of mathematical specifications indicated 
that at least a third of these problems could also 'be 
examin^ within othe^ specific categories. For the purpose 
of this* analysis, 22 fourth grade items and 13 seventh 
grade items were placed in this^ category. They represented 
a iotal of 40 and 27 items respectively for the four years 



of testing. This was 26% and 18% of all items administrated 
at j/hos6 levels. Medium difficulty^ level for the iliems 
13, i 



was 13,0 and 14\0 compared to 12,6 for. all math items. Hence, 
the word problems tended to be slightly more diffiuclt than 

oth&r items. 

• * - 

1 The word problems which were easiQ,^ for 4th graders were 



(V8) 




Kathy has only 3 black kittens "and 
6 white kittens,- How many kittens ^ 
does she have? ' 



(A) 18 . ' 

(B) 9 ' , » ^ . . 

(C\ 6 ■ , 

. (D) 2 H %: " PL 7.8, 90% 
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iSZ\ TUV4) Jill had 203 stamps and lost 4 of them 
How many stamps does she now have? 



9 

' <A) 199 ' * • 

(B) 207 
. (C) 209 

(D) 243 ' . , . 

PL 9.5, 81% 

The most" difficult word problems for 4th -graders we fe: 

(V40) Jack's spelling test has 100 words. He ^ 

3 

spelled -'of the words correctly. How 
many words did Jack misspell? 

<^ (^75. ' . ' 

(B) 40 < . ■ ' ♦ 

(C) 25 • '• . , 

^ ... PL 15.9 . 33% 



( 40) ' If Bot is fifth in a line of children and 
' Bftlis twelfth in the line, how many 
^ . children are .between Bob and Bill? 

♦ • (g/ ■ ■ • 

^ (A) Six 

(B) Seven ' ■ . 
•*. (C) Eight 
(D) Nine 

^ . . . DJ. 16.. 4^ 25-% 
^. - ■ 

% : • *• . 

r • 

(T39 , UV37) John bought 7 pencils for 5 cents each 

• ' and a box of chalk for 20 cents. Which ' 
. coufd be the correct change he got _ 
from a dollar? 

« 

(A) 2 dimes and 1 quarter 

(B) 2 quarters 

^ (C)' 1 niekel and 2 quarters 
.(D) 1 dime and i quarters 



DL IS. 5, 30% 



The' easiest items dealt with; simple addition and 
subtraction which are well>ithin the 4th grader^, repertoire 
while the harder, except for U40, involved multipliiration 
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of whole numbers and the use o£ fractions,' topics which 
are. new to 4th graders. -These* results would certainly 
support the hypo thgsisl that projEiciency in th^ matHematical 
concep,ts- involved is a necessary condition to. solving a 
word problem. They may even suggest that prof iciency in 

* the mathematical concepts is the dominant factor. Pursuing 
that a s-tep further, whole number addition or subtraction 
were required for six'" word problems in which average 
performance was 731 correct and the difficulty level 10.1. 
In 9 it^s involving ^multiplication or -division the average 
performance was 461 with' a difficulty level of 13.^. That 
pertormance was not greatl)^ different from the 6SI - 42t 

* comparison obtained from comparing two pure addition, 
sub-traction items^tjo two multiplication, di-visipn items. 

' For tlie 7th grade, tjie easiest^ of 13 items were; 

(tI , UV9) ^ On a 2-hour trif>. Jack drove atan 

average rate of 4S-miles per hou^ ^ 
What was the total number of miles * 
that he drove? . . ' 



(A)^ 22^ 



(B) 60 

(C) 90 ' . ; . ' . ' 

(D) isflll ■ ^ ^ DL 9.3, 82% 



(T.U V3 5 ) On "Monday Tim had $20". If he then 
earned $8 selling ne\yspap>ers, spent ■ 
$2 fbr a book, spent $1 for a movie, 
and earned $6 running errands, how ' 
much did 'he have? • - • 

"(A) $11 ' • 

(B) $26 .. . ' 

(C) $31 . • PL 11.0, 78% 
, (D) $37 • • 



The most difficult items were 



(V32) On field day, 7 children thB * 
. 50- yard dash and 8 children ran 
the 100- yard dash. If a total of : 
12 children entered theCtwo races, 
how many ran in borh races? ^ 

(A) 3 

(B) 4 



/ 



(D) 15 " . , 



C ^ ) What Is the greatest number of squared of cake 
2 inches on a side that Jane can cut from a cake 
15 inches by 8 inches if the thickness of each 
square is the same as the thickness of the cake"? 

(A) 21 * 

(B) 28 . ■ 

(C) 32 , • V - 

• (D) 34 ■ • . . DL 14.7, 36% 



CST28) „ „ o ^ 

^ ■'N AB- C -D 



I I I — 1 ! 1 I I I I I 1 I — m — I i \ s 

0 12 3 --r : 

/ • ' -ri-^ 

/ * 1 ' * * / 

' Arrow N is pcsindng to - on die line above. Some / 
number times |- is equal to 1. Which arrow is p 
^ polnrlng^to^is siumberT * ' ' * 

(A) A ' ' ^ . 

(B) B 

(C) C : - 

(D) D , - ' 



Bh 14:6> 36% 



The ability to reason, rather than computational -skills 

was prerequisite for more difficult items^ for 7th graders. 

However, the ^easier items were concerned with mathematics 

with which 7th graders. are quite proficientl Pursuing the ' 

hypothesis 'that proficiency on mathematical concepts implfes 

ability to-do word problems, and assuming 7th graders are* 
♦ n ' 
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quite- proficient in multiplying, adding, and subtracting whol 
numbers and weaker in dividing y^hole numbers and worJc with 
fractions, oije finds a. 67%-- 401 comparison- in performance 
on five pure computation items in each of those categories. 

On items in which reasoning might bepclassed, as a \ 
dominant factor.; as in the mo^t difficult above, the 4th 
graders performed' at a 4SneveL^nd the 7th at 36%. After 
deductions for guesses, that becomes' 27%. and 15%. Assuming 
the average reading level is comparable, .that would indicate 
that the ability to . analyze and deduce is a severe, handicap 
to all but the better ^students- -a filing which is not very 
surprising. One wonders if those percentages may not 
indicate that very little time is spent in .gSving stTiSent^ • 
experiences which" require reasoning. • ' 

Another interesting comparison which emergedfrom the 
4th grade testing is related to a change in wording in two 

otherwise identical items. The two versions are listed below 

\ 

(Tl4j ^ 

^ . Ed's house is 24 blocks from Al*s. Joe lives \ 
halfway between. How many blocks is it from 
Joe's house to Ed's? 

(A) 2 ' . ■ . * 

(B) 6 ■ . . 

(C) 12 , • • 
.(D) 48 



/ 

(SI 4) Ed lives 24»blcx:k8 away fronj Al, Joe liv4s halfway 
. between Ed's house and Al's. How tnany blocks 
must Ed ride on his bike to go from his house to 
Joe's house? 



(A) 2 

(B) 6- 

(C) 12 
(P) 48 



c , 
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The change is slight. Ten more .words' we're used in 
t'he second version and perhaps a-less direct sentence 
strutrtur.e. The result was a* change in difficulty level 
froin 11.1 to -11,8 and perpentage correct, from '66 to 62.' '* 
Not much difference, but it does repre-s^jit around' 4 studen'ts 
in a sample of 100. and it gives some insight'^to the 
subleties pf helping students' learn mathematics. It also 
challenges one -earlier hypothesis concerning mathematical 
concepts and word problems . ',.'•' ^ • ' 



SUJ4MARY 



As part of an assessment of Michigan educational 
programs, the Department of Education, tested nearly a:^l 
Michigan 4th and' 7th graders early in 1970, 71, 72, and 
73. Tests in mathema-f ics were prepared -by* Educational • ' 
I^tJting Services- and based on specifications drawn from 
mathematics tests- in use in Michi^afi.. The tests -were 
intended to establish the performance lev^ of the 4th*'. 
and '7th, graders, in the basic skijls.and to 'determine the 
relationship of the performance and progress yo cerj^^n - 
socio-economic characteristics. 

The mathematics tests were carefully • constructed to 

prtf^de normative information. Whiie .mathematics 'educators 

have expressed concern about the selj^ction topixis, aiy 

such test can include only a sampling of items, and 

crifeisms related l;o the choices are virtually junavoidable. 

• / However, sxnce trhe petfoxmance level was l)r.oadIy 

e^stal>lisheJ by the test makers, and since the test was liot • 

administered to" aiiother notm" group, it failed to yield , 

comparative information cpncerning^.the level of. performance 

pf Michigan yourigs.ters, In inathematics-, the test^^'discerned 

ho change in performance for the first four /years of . 

administra'tions. .Public reaction to attempts .to detet-mijv^ 

socip-econoBiic characteristics complicated attempts to 
• , ■ • . • 
relate achievement to those characteristics. ' * 

The period covered by the tests was marked by .significant 

•fl^ttuations in local* factors which affect school programs,' 



but they have reoeiveciifminimal attention in tha interpretation 
o£ results. The effects of such critical items as educators 
per 1000 studepts, investment p^r student in real dollars, 
reduction in staff, and public attitude towards education 
have not been determined. Perhaps the .^heer •stability, of 
tpst results through so turbulant a period re?^esents a 
.substantial accomplishment. 

/ Extensive data drawa from a, statistically stable 
sampling of 'Student performance oil each of thp test items 
has be§n used as abasisfor this analysis* That data fpr 
subsets of the School districts has not^been available 
■for the analysis. .1^1 1 has' not been possible, therefore, to 
differentiate the implications of performance on specific 
items for school districts which share comrfon characteristics. 

••The analysis has been further limited by the normative* 
nature' of the teat.- Frequently, itemS did not isolate.. ' 
conceptjs. Observations related to the performance on 
those items reflects a qualitative interpretation of the 
results. If the improvement of instruction in specific 
concepts is a goal of tljie assessment process, then the new 

criterion referenced test>s should be much more useful. 

♦ ** 

However neither test yields the comparison of peifornfance 

by. Michigan students, to other students which is necessary to 
determine 'the achievement level of mathematics in Michigan". ' 
(p. 4) . '• 




Ba-^ed on .this author's examinatjpn'^'oTthe results of 

7 0 ""^ 
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student performance on the iteas, the following remarks ' 
, describe those features of performance in broad general 

r * 

areas which' seemed worthy of note. 

*# ' • 

On Whole ^Numbers 

' Less than 50% of the 4th graders had a functioflal 
command of the place value concept of the number system* 
Performance improved somewhat by grade 7, but even there 

4 

.-<ft must be seen as limit^ii^g students' ability to function 

with'^tTTevWhole numbers. There is also very strong evidence 

that a large portion o£ the students did not understand 

the relation of multiplication to addition, , ' 

Perhaps 'the most significant finding here, one not 

peculiar to this analysis, is that in most concepts related 

to whole numbers there is a large number of students who. 

can perform and do understand, as well as another large 

group who cannot and do not. This is a strong- indication 

^ 

of a need for ddf ferentiate'd instruction Recent MDE 

interest in identifying mol-e effective delivery systejas 

could foster the development of improved techniques for 

differentiating. instruction, ^ 

There are also rather strong indications that 4th graders 

would find some of the vbrk with fractions easier than the 

more complex work with whole numbers That raises the 

question a^ to whether some redistribution of instructional 

time between fractions and wjjole ■ numbers ^in grades 3-6 

might not be helpful. 
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Fractions 

K'hen considering the limited time spent on fractions 
prior to January of the 4th grade, performance* on fraction 
items was qJ4te good. Fourth graders seemed to be able 
to relate fractions to geometric regions more easily than 
to sets of objects. The number line offers very 
questionable support to their understanding. This is . 
probably related to the fact that, historically, fractions 
emerged from the necessity to describe part-whole 
relationships, and while theinit tends to be clearly 
identified in regions, it is far more obscure in sets 
and on the number line- ^ » 

Intuitive^understanding^of one-half- and one-quarter 
was quite strong and could be useful in work with fractions, 
^ There was very limited opportunity to laok at 7th 
grade performance in thi.s area. However, 7th graders were ^ 
very weak in their ability to add and subtxac.t cjpjnmon 
fractions and only the more able were functional with decimal 
fractions . 

• o 
Performance by 7th graders on this section of items 

was very disappointing. It clearly establishes that- 

instruction in fractions was, not effective , . IVheth'ef or not \ 

that applied to local districts will need to be determined 

through local evaluations. However, a more detailed 

evaluation than this one seems likely to simply add more 

particulars to the .indictment . 
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Properties of Numbers an^^pperations 

While generalizations concerning numb'ea-s have been 
given a majtjr emphasi^ in modern mathematics, texts, the 
test responses indicate that only a small number of 4th . 
and 7th graders understood these generalizations . Whe-ther 
this reflects instructional deficiencies or a lack of 
learner readiness, present knowledge of those concepts ' 
forms a very shaky base for the development of algorithms. 

Measurement 

— . 

Performance 'on measurement items seems to point to 
the fact that there are a i)umber of perceptual subleties 
at work when younger istudents "are requested to work with ' 
fractions of iMfiit^/ 

Botly^h anc^ 7th graders had difficulty using metric 
characteristics of squares and parallelograms and only 
the ifj^st students were able to find the area of rectangles 
wjLth "simple dimens-i^ns» 

Seventh graders also had difficulty with items 
requiring conversion from one unit of measurement to another. 

•■ Performance on problems involving ,^'t?tple applications 
of -lumbers to geometric figures or other fp^rms of measurement 
caused Michigan students, a great amount of difficulty. Of 
all%treas on the tests, this was one in whfiteh need for - • 
■ improvement was most obvious- ' . 
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Geoifletric Properties of Figures 
I • ' Michigan students seemed to show a strong abilit-t 

to analyze Vrobljems involving distance on a gridded plane > 
This^ offers opportunities which we have begun to explore? 

il 

, with the ^geoboard, but' perhaps those experiences more 
rightfully belong in the regular program than among 
enrichment experiences as has frequently been thq, case. ' 

Performance on "more .specific geometric relationships 
was as weak here as it was in the measurement items . 
Parallelism aiid the radius -diamet-er relationship, for 
example, troubled 1/2 and 2/3 of the 7th graders tested. 

Formulas and -Graphs 
. . ' ^ More than ^alf of the students had difficulty in 

► evaluating simple algebraic expressions involving' bperati'ons 

with which they were otherwj^se familiar . sThis raises 
questions concerning the practice of expressing generalizations 
. ' • through th^ use of such empires s ions' ;^ i.e., , " ~ - — 

• (a .X b) X -c = a X (b X c) . 

• About half' of the 4th and 7th graders were able to- 
make straiglit-ficflrwaTd interpretations from bar, ^line, and 
pictographs . Seventh^.grade perfiormance on circle graphs 
was only slightly lower than tha*. Because of the frequent 
^ practice of presenting" quantitative information in this 

form, work is needed to enable all students to understand 
such information. * 
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Equations and Inequalities ^ 

Many of the comments which Hiigh.t be summarized here 
have already 'been discussed, -i^e have already disx:ussed* 
difficulties with the use of letters, to represent 
numbers. Students did, however, demonstrate some ability 
to work with statements expressed symbolically. 

The test indicated a gradual grdwth in the ability 
to work with the symbol '">". Most students beyond the 
7th grade vill understand its meaning. 

Word Problems , 

— ^ — ' V 

In spite of an unusually large number of items in 
this category, perfonnance on them does not support any 
finii conclusions, ^lowever, they do suggest 'two 
observations. First of all, while reading is a factor in 
working word problems, the item statistics seem to suggest 
that understanding of the mathematical concept involved 
was probably a more significant factors for most studentlu 

One reviewer remarked that the following item was 

trivial ^or fourth grader^: "Kathy has only 3 black kittens 

t ^ ■ 

and 6 white kittens. How many kittens does she have?" 

The same reviewer did not see these items as trivial, 

"Jill had 203 stamps and lost 4 of them. How many -stamps 

•does she now have?" or "Jack's spelling test has 100 words. 

He spe.lled 3/4 of them" correctly. HoV^many words did Jack 

. miss|)ell?" The reviewer was obviously focusing on the 

mathematical concepts and not the reading. concepts involved. 

ry ' ■ 
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A summary of items usecf^ this test suggest that facility 

with themathema^jjCal concepts is the major, stumbling 

block to solving word .problems . 

Students had predictable difficulty with items • 

which invol\>ed somewhat complex reasoning even though the 

♦ 

concepts were quite familiar to them. Despite a "modern" 
emphasis on mathematical reasoning, this test does npt ' 
indicate that the ability to reason is a strength of 
iMichigan students . 
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CONCLUSIONS 

Fir-st of all th&>Mi<:higan Department and BoaTd of 
■ Education should, be congratulated on this massive effort 
to put Michigan education on a more rational basis . The 
obstacles to gathering information on this scale are^ 
many and the state -level edtiR:atoiLs must be commeiided for 
the hard work and persistence which road^ these tests a 
reality; The MDE pufci icatiOiTs consistently reflect a 
basic concern that the a5ses5ein)?t program shoiJld befftoTne 
an instrument fqr use by local districts to improve 
education throughout Michigan. ^Th^se responsible ure also ' 
to be commended -for recognizing that the vigor and 
understanding necessary to general improvement niust:come 
from the districts and cannot ^emer^e from a rigid 
regulatory system. As long as that posture is maintained, 
.the assessment prpgrmm needs and deserves the contributions^ 
of Miefiigan educators and their organizations. 

This analysis has raised many questions; it has answered 
few. • It is especially apparent at this point that another 
reviewer might have detected other significant bits of 
information and added a more judicious interpretation than - 
that whij^h is reported here^ However", the economics of time 
and money have dictated this narrow base, and the reporrt- 
cannot. escape the associated limitation. * 

It must be concluded that in the area of mathematics 
t hese tests did not determine the level of achievement of _ 

77 . • ' - - 
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Michigan 4th and 7th graders in comparison to any reference 
group which exists outside o£ Michigan. That sobjective for 
the tests could have been met by using any appropriate 
nationally normed standardized mathematics test. 

The tests did indicate that there was no noticeable 

z ' ' ' 

ch ange during the first four years . But that assessment 
did not clearly establish how ^mathematics performance is 
affected by such factors as: economic support, class size, 
student ability, stud-ein^ effort , or other forms of support 
or interference. . Hence,! it is not possible to determine 
whfe^her absence of change represents stagnation, stability, 
or a tremendous effort against overwhelming odds. It would 
' be very useful to have good information *on how such factors 
do affect the learning of mathematics. * , . 

These tests did- provide enough information concerning 
instruction tjhat the time spent in taking them tvas 
wort?iWhiIe. This is particularly true if local districts 
^ examine the data foi; implications for instruction at the. ^ 
local level .> Rowever, if the primary purpose of the tests 
had been to obtain information to serve as a basis for 
improving mathematics instruction, a criterion- referenced 
instrument vould probably have provided^ more- useful 
information. Having made the d-ecision to move in. that ^ 
. direction, a i»ainpling program involving many more items 
wbuld also yield a far greater amount of information. This 
entire analysis has, in fact^ been based' on samples of 
approximately 1000 students each. If itc^had been designed on 

■ • - r~ - . 
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'that basis, it could have provided much more information. 
However, the conduct of such a program would require a 
far greater amount of support for design, administration, 
and interpretation than has b^en available for this . 
program. 

This analysis deals with average performance My all 

4th and 7th grade students in the state. It, 'therefore, 

^ has very restrict^ meaning for any particular district • 

and' even less for a particular classroom. At best, the 

findings identify a nuiRber of critical p oints which deserve 

■ — 

the attention of school districts and classroom teacher,s. 

If less than half the 7th grade students in the state can 

work in a meaningful way with tifie.area of rectangles, 7th 

grade >teachers throughout the state might .suspecr that 

their students may have difficulty. More basically, if 

large numbers of 7th graders in Michigan do have difficulty 

with symbolic representation of Concepts by the'use of 

letters, it is very likely that almost' every district 

(classroom?) has some of these students. 

The results of, the study do point to at least^two 

characteristics of 'the mathematics program which require 

•careful /xamination. girst of all, the test, performance 

points to the inappropriateness of teaching all students' af 

a particular grade level -as though they were ready to learn 

the same mathematics . Gagne's studies (21) have pointed 

out the futility of attempting to learn a^.mathematical 

cc^cep-t withotit being suitably fortified by the background 

concepts. .Variability in the understanding as veil as the 



ability to use a particular concept is a normal characteristic* 

o£ a group of students. WhiLe some variability can result 

£rom^ne££ective instructional practices, an ^instructional ' 

progr,am which enables students to r^ealize their 'full ^ ■ ' 

potential, is likely to increase variability among, a grouj) 

of students^ even* more. 

Mathematics insti;uction responsive to the needs and 

readiness level of stude"^^ must be based on differentiated 

instruction for students at a particular grade level.. 

Management problems have frustrated attempts to achieve ^ 

a suitable b^lahce between more personalized instruction and 

opportunities to interact "^ith other students and vhe 

teacher. But mathematics instruction simply must- become 

more responsive- to the learner. . ^ 

Secondly, there- seqns to be continually increasing 

*^ * • 

evidence that the mathematics prograttis examined by these tests did 

result ii^ undesirable oatcomas fox jnany students^ ^ TJiose 

students are not learning 'mathematics in a context which is 

meaningful to them. They cannot use mathematics to * • 

answer questions which are of everyday importance. They do 

not become quantitatively literate. * Is the focus oji basic ^ 

number properties appropriate for S9mei students but not 

others? Is the focus appropriate but our teaching methods 

ineffective? Do students* have sufficient number sense based 

6n.the real world to understand the abstractions dr are the 

I 

abstractions simply na% within the perceptual capabilities 

. * / 00 
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o£ some students? We do not know the answer to these 
questions but we do know that the pursuit of the abstract 

.has prodliced students' whb lack Understanding of both the 

^abstraction and the real world, interpretation. 

We must conclude 'with Dr. Suppes that: 

, \ "as .yet theories of 1-earning have little to 

offer in providing insight into how one learns 
to thiiik mathematically." • ' 

• "...we. do not yet understand with any reasonable 
degre&sOf scientific detail what gifes on when a 
student learns a particular piece *of mathematics*^* 
whether the mathematics in question be first 
grade arithmetic, undergraduate calculus or ' • 

graduate school topology.^'/ 

.These observations, coupled with this analysis and data . • 

fromPiaget on studies of progressive changes in behavior ' 

and thou^t in the "developing c1t3>id, require that we proceed 

cautiously. We must continue the search for more effective 

ways to help students understand mathematics.- 

• * 

. One l^st comment concerning the new^nd promising 

development in MEAP to apply objeci:ive-r9^ere7iced tests to 

examine the achievement of minimal objectives. Jhe identif icatioa*. 

of minimal objectives should sharpen our perception of the ' 

effectiveness of instructional practices for certain 

J . . • ■ 

students. But it carries w4:th it t*he danger that we will 

not pursue appropriate objectives for all studentsV We 

are inexperienced in. the -use 9f minimal objectives and must 

make certain that, in providing all students with the tools 

necessary for everyday living, we do hot'^deny to more . . ' . • 

capable students the understanding necessary to confront 

8i . . . 
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the complex problems of^ an increasingly^ tectoical 
society^ Werped to provide "for both of these extremes, 
and^the many variations between them. ' ' 
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■ ' APPENDIX A • _ ' <s» 

Mathenatics Test Content Specifications 



. . ^ Number of ITgMS • 

t *. " Grade 4 ' ' Gra%e 7 



y 70-^.1 '* 72 .73 70-71 72 ' 73 



NUMBER AND OPEBat IONS . 15-20 Item-s ' 10-16 IteHS 

A Operations with integer! 

. (whdi-e numbers) . * 4 7 7 1 t A ^ 

B. Pla<?e --value ^ 2 4.2 1/^ 11 

C. .Properties of integers^- • • / 

divisibility ' : 2" 11-,^ 21 

• D. Proper fractions . ' • 2 3 4 ' ^4 
E- Decimals and percents 0 0 0 \ 1 i*"^ 

Properties of oper^.tions (Com- 
mutative, associative, dis- 
tributive, closure) . 2 -2 . . 2 h 2 2 
^C. Estimation' " 1 '1.1(0 11 

* H*; Spjecial propertie's of .zero • ^ - ^ 
^ • anxj one' , ^ 2 2 2 • , /^2 1 1 

•J* Average » ' o'-O O' l' 11 



2. GEOMETRY AND >iEASUREMENT ITEMS ' * ITEMS 

^• , * . ^ '3 6 6 7 *- 9 10 

^ Units pf jneasur^, length, weight,- ' / 

time, 'temperature, money 1^ 1 X ^2*-^ 3i 

■ B. Perimeters and areas of simple • * - 

\ ^ polygons \ ' %^ 1 • ^ I" 1 .1^ ^3 

^ Ci ;S.cale drawings and maps , 0 *l ' 1 . 1 -l 1 

D. Proper ti^es of polygons and ^ ■ * , 

the circle v> "*.* 1 l>»i 2 I'l 

" -f. E. AjigleS'Snd intuitive ideas of " \ — ' ^ . ' 

geometfy. , 0,- Ji 1 / 1 1. ^1 

F. Non-metric geometry ^ ^ 

*• * • 

3.' > RELATIONS > ^UNCTIQNS., GRAPHS 2 .2 2 . 4 ^ 4 4 

A.,v 1/6 e of mathematical formula ► I*'* 1 1 11 

BJ Reading and ititerpreting graphs X i * 1 3 5^ 3 



4. . LOGICAL THINKING . 1 1 • 1 ■ • 1 

. \ ^ ^ * ' ' . 

A.^ 'Intuitive ideas; Counterexample* ^ A. . ' * 

reasoning * ' • . 1 ^ i ' i 



• 
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5* MATHEWICA L' SENTENCES 


A. 5qu3.tions 

B. Inequalities' 

6: APP£'I CAT IONS 

.Word problems (other than those 
.' already listed in one of the 
categories a^ove) 



1 
1 



ITEMS 



2 
1 



2 
1 



T 



Page 2 



ITEMS 



2 
2 



2 
2 



4 
.2 



NOTE: At least one,; third of the prob-jLems could be 
classified as applications. 
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APPENDIX B > 
CHARACTERISTICS OF THE MICHIGAN ASSESSMENT 
* 'MATHBIATICS T£STS 1969-73 
• . GRADES 4 § 7 



GRADE 4 



GRADE 7 



Number of items 

Raw Score average 

correct average 

Standard Deviation 
raw score 

Percen-tag^ Score-) 

Reliability 

Difficulty 



the last item 
the 3/4 point 
►Discrimination 



Item difficulty 
scores 




1970 


1971 ■ 


1972 


1973 


1970 


1971 


1972 , 


1973 


1005 








'1005 








30 


,40 


40 


40 


30 


40 


40 




16.3 


21.78 


22.96 


24.5 


16.0 


21.4 


23.8 


24 .1 


54.3 


54. 5 


57.4 


61.2 


53.3 


53.5 


59 . 5 


60.3 


5.7 


7.29 


7,27 


7.7 


5.9 


7. .7 


8.1 


7.8 


18.0 


18.2 


18.2 


19.2 


19.7 


19.2 


20.2 


19 5 


.83 


*.86 


.87 


. .89 


.84 


.87 


.87* 


.8 


54.3" 


52.5 


57.3 


61i-2 


53.3 


53.1 


59.7 


6i.2 


of percentage of students 


who reacheA 






88 


87*- 


86 


90 


90 


87 


90 


95 . 


•97 


96 


96 


97 


98 


97 


97 


99 




.48 


.52 






.51 


.55 




50.0 -• 


50.5. 


50.6 


SO. 9 


50.0. 


50.0 ^ 


50.0 


50.3 


# 
















12.5 


12.7 


. liz.i 


* .r 


12.6 


12.6 


11.9 


















1 




• 
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APPENDIX C . ' 

— # 

TEST QUESTION ATISTICS 
(ITEM ANALYSIS) 



Item Analysis is a detailed statistical description of how a 
particular question functioned when it was used in a particular 
test. The analysis provides information about the difficulty 
of the question fpr the sample on which the analysis is based, 
the relative attractiveness of tTie options, and how well the 
question discriminated among the examinees with, respect to a 
chosen criterion. The crit^ion most frequently used is total 
score on the test of which the item is a part. However, the 
criterion may be the score on ^ subtest, on some other test or, 
in general, any appropriate measure that. ranks the examinees 
from high to lo\v. 

The portion* of .a typical * item analysis that a Committee member 
is likely to meet is re^Jfbduced below, followed by an explanation 
of each of the designated entries. The analysis is based on a 
sample of answer sheets carefully selected tt> be representative 
of the total group \ftat took the test. 



FORM 
MEP 


BASE N 
370 


CMIT 
30 


A 

209* 




r 

50 


D 
13 


E 
23 


^OTAL 
13.1 


JBP 


12.6 


CRITERION 
IS45 . 


t 

TEST CODE 
MATH 


IT^ NO. 
?6 


Mq 
10.6 


14.4 


13.0 


,10.7 


«D 
11.4 


Me 

J0.2 


^TOTAL 
.99 


.57 


^ ■ 

12.4 


.49 



The F6ur -Boxes to the Left of the Doubles Lines: 

Form and Test Code : These identify "the test. The first f^^ 
letter 'designates the year is 1964, Q 1968); BP means 
Advanced Placement. . lest Code gives subject. 

Sase N : Nuiftber of answer sheets in the sample. 

Thus: These four boxes' say that this is the ^al^ysis ' of 
question 26. on the 1964 Mathematics Advanced Placement 
Epcamination^ based on a sample of 370 papers. ' * 

The Twelve Boxes Be tween the Two Sets of* Double Lines: 

' ; ^ ^ *^ 

^ On the 'top row, the box labeled OMIT shows' the number of 
individuals iji the sample who omitted this qqestion but 
answered a subsequent one an^- the boxes labeled A-E show 
the number who phose each option'. ' 




} 



Thus, OMIT 30 means that 30 examinees skipped this 
.question but answered at l^ast one questito later in 
• the test. . , • ■ 

(Note: a pers*on is c*onsidered to have droppe<i out after the 
last answer he has marked; dropouts are not included in the 
analysis of a question. Omits. ar6 assumed to have considered 
the question and are included with incorrect responses in 
computing the. difficulty index for a-squestion.) 

The Ke^ is Marked with an asterisk. .In .this case 209 individuals 
«jpse A, the correct answer. ^ . . 

' ^ <e * 

4^^he second jrow, Mq, Ma, Mb, etc. indicate the average 
ability level or mean criterion scor-e of the examinees who 
chose each option"! This mean criterion score is an index 
describing- the average abilify level of the candidates on a* 
scale which has a mean of .13 and a standard deviation of 4. 

For example, if the /criterion beiag used is the score on the 
total test, then the average sgor? of the entire sample on the 
test IS assigned the index 13.0, which is considered t be the* 
mean criterion score of the total sample. If the average of 
scores of the group choosing an. options is above the sample 
average, their mean c^-iterion Hcore will be greater than 13.0; 
if their average, is below the sample average, it will be less)' ' " 
than 13.0. These criterion scores are related to percentile 
rank of performance on the criterion approximately ^s. follows : 



Criterion Score 



20 or 
18 or 
16 or 
14 or 
above 
below 
12 Ol- 
io or 
8 or 
6 or 



above 
above 
above 
above 
13, ' 
.13 

below 
below 
•below 
below 



Relative Rank on Criterion 
T ^ 



riiighest 5% 
highest 101 
highest 20% 
highest 0% 
upper half 
lower half" 
'lowest 40$ 
lowest 20^ 
lowest 10% 
lowest 5% 



.In the^examgle^ the mean criterion score, Ma those choosing* 
the- correct answet A wds, 14.4, higher than that of any Qther 
group. .jThe weakest group on the average were the 23 w^o chose 
E an4 wjfiose taean criterion score of 10.2' puts^them in the 

•bot^m quarter of the sample. ' . 
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The Eight Bqxes to the Right of "the Double Lines : 

The meanings of the labels in this- group of boxes are 
as follows: 

• * 

. P. TOTAL is the per cent of the. sample still answering 
.questions; i.e., 99% answered question 26 or a subsequent 
questions (The dropeut at this point is 1177"^=^ ^ 

- MTOTAi is' the mean criterion score of the P TOTAL, in 
this case- the dropouts tended to be below average in 
abiity so that M TOTAL is 13.1, which is slightly * higher 
than the 13.0 for the complete sample. 

P^. (per cent pass) is the per cent of the P TOTAL. that 
■W answered the question correctly. In this case, 571 af 
^66, or 209. 

Clearly,- r itself is not a very stable statistics and on.e can 
expect It to vary from one use of the item to another. The 
r biserial .of an item will be affected by such things as the 
extent to' which the item measures what the test as a 
wh9le ijjeasures, the appropriateness of the question for the 
particular- group of examinees,- and the amount o$ Variability, 
withm the examinee group with respect to the ability beine 
tested. . \ } & 
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